2024-08-12 Waku Weekly

Milestone - Store Service Upgrade §

• Store v3-beta - Message Hashes

  • achieved:
    • [js-waku] feat!: store v3

• PostgreSQL Maintenance

  • achieved:
    • [nwaku] PR almost merged with optimizations in messageHash queries through lookup table chore: Optimize hash queries with lookup table
    • [nwaku] submitted PR in infra-status to fine-tune the Postgres settings after having increased the hw specs store-db add more appropriate db settings for current db hw

• Store v3 - store synchronisation

  • achieved:
    • [nwaku] PR review WIP to add Waku Sync feat: Nwaku Sync

Milestone - Direct Message Reliability §

• Tooling: filter and light push protocols

  • achieved:
    • [nwaku] Started using liteprotocoltester tool to send lightpush msgs from a node located in Frankfurt and receiving through waku-filter in a node located in Sydney. Both are connected to one node in status.prod fleet.
    • [nwaku] liteprotocoltester tool helped to discover duplicated messages problem
  • next:
    • [nwaku] carry on with duplicated messages issue

• Telemetry: direct message reliability

  • achieved:
    • [chat] report peer id and number of connection failures to telemetry feat(telemetry)_: send connection failure metric, feat: handle metric for peer connection failure

• Reliability Protocol for Relay

  • achieved:
    • [nwaku] Development of subscription awareness for delivery_monitor module feat: enhance reliability thanks to StoreV3

• Reliability Protocol for Resource-Restricted Clients

  • achieved:
    • [nwaku] ongoing implementation in nwaku feat: Enhance lightpush protocol error handling
    • [js-waku] filter API refactor for ease and DX: feat(filter)!: new simpler filter API

• Review MVDS usage and fail path

  • achieved:
    • [chat] bump mvds for clearing old states chore_: bump mvds

Milestone - End-to-end reliability protocol §

• End-to-end reliability protocol - PoC
  • achieved:
    • [research] peer retrieval of missing messages, reconnect capability for tests, conflict resolution; and raised a final PR for POC
  • next:
    • [research] address review comments, dogfooding

Milestone - Static Sharding - dedicated shards §

• Sharding peer management and discovery hardening
  • achieved:
    • [nwaku] Continued investigating bug: node getting stuck and missing messages
    • [nwaku] Found “Futures” leak in yamux and confirmed that it doesn’t happen on mplex. Opened an issue in nim-libp2p bug: yamux Futures leak and a PR in nwaku switching back to mplex chore: using mplex instead of yamux
    • [nwaku] Got feedback from Nimbus and new potential ways to debug bug: node getting stuck and missing messages
    • [nwaku] Completed bug: Node accepts connections when configured for just discovery, optimizing the connection management of discv5-only nodes
    • [research] libp2p rendezvous wrapper impl. at the waku layer
  • next:
    • [nwaku] Try the recommended debugging techniques
    • [research] namespace definition, discovery strategy

Milestone - Scale 1:1 chat messages PoC §

• Maturing RLN variables/parameters revision

  • achieved:
    • [research] raw spec PR for RLN contract mainnet deployment: Add WAKU2-RLN-CONTRACT spec for mainnet deployment
  • next:
    • [research] continue the discussion around the PR, finalize the initial version of the spec

• Pay for RLN provision first PoC

  • achieved:
    • [research] PoC with a paymaster in zksync, written in golang
  • next:
    • [research] continue work with paymaster to sponsor tx fees in zksync
  • blockers:
    • [research] lots of issues deploying rln to zksync

Other Work §

Enhancements §

• achieved:
  • [nwaku] upgraded the peer exchange mounting procedure - chore: upgrade peer exchange mounting](https://github.com/waku-org/nwaku/pull/2953)
  • [nwaku] Successfully reproduced the PR exchange issue - bug: failed to retrieve peer info via peer exchange protocol
  • [nwaku] Made progress on testing tools - test: peer exchange testing tool
  • [chat] refactor: move rate limiter and priority queue from status-go to API package refactor: move rate limiter and priority queue from status-go to api package
  • [chat] refactor: move missing messages logic from status-go to go-waku, refactor: extract missing messages logic to go-waku
  • [chat] refactor: remove unused code from wakuv2
• next:
  • [nwaku] Resolve the PR exchange issue bug: failed to retrieve peer info via peer exchange protocol
  • [nwaku] Complete peer exchange testing tools test: peer exchange testing tool

Bugs §

• achieved:
  • [nwaku] fix: missing wakuv2 fields in createAccountRequest toJson func
  • [chat] fix: storenode multiaddresses
  • [chat] fix: handle scenario where the node’s ENR has no shard (due to shard update)