2024-07-01 Waku Weekly

Milestone - Store Service Upgrade §

• Store v3 - store synchronisation

  • achieved:
    • [chat] set lower max delivery attempts for outgoing messages https://github.com/status-im/status-go/pull/5382

• DOS protection for req-res protocols and metrics

  • achieved:
    • [nwaku] BW metrics per shard: implemented per shard metric collection - https://github.com/waku-org/nwaku/issues/1945
    • [nwaku] Added dashboard panels for relay per shard traffic
    • [nwaku] Added dashboard panels for non-relay protocols data traffic
    • [nwaku] Added dashboard panels for non-relay protocols request rates
  • next:
    • [nwaku] Rate limit phase3: Some polishing and test cases needed to finish

• PostgreSQL Maintenance

  • achieved:
    • [nwaku] analyse a database blocking issue: https://github.com/waku-org/nwaku/issues/2838
  • next:
    • [nwaku] fix database blocking issue with solution detailed in https://github.com/waku-org/nwaku/issues/2838

Milestone - Direct Message Reliability §

• Enable testing of direct messages

  • achieved:
    • [chat] small logging cli issue
    • [chat] testing private group chats https://github.com/status-im/status-cli-tests/pull/4

• Review connection management strategy and back-off and fix long disconnection issues

  • achieved:
    • [chat] investigating connectivity and discv5 issues
    • [chat] fix peerExchange to filter peers by shard https://github.com/status-im/status-go/pull/5350/
    • [chat] filter peers used for circuit-relay based on shards https://github.com/waku-org/go-waku/pull/1130
    • [chat] Dogfood lightClient by enabling peerExchange
  • next:
    • [chat] missing messages verification https://github.com/status-im/status-go/pull/5281
    • [chat] store node query after sleep https://github.com/status-im/status-go/pull/5422
    • [chat] investigate further peer connectivity issues by dogfooding
    • [chat] refactor peer-manager for lightClient
    • [chat] remove limit on connections when using relay

• Tooling: filter and light push protocols

  • achieved:
    • [chat] lite-protocol-tester works on waku-simulator
    • [chat] configurable stress conditions
    • [chat] re-run some critical test for nicer logs for analysis
    • [chat] analysed run results
    • [chat] waku dogfooding telemetry https://github.com/status-im/telemetry/pull/20
  • next:
    • [chat] new run with analysis on Alberto’s log analysis tool
    • [chat] run lite-protocol-tester on shards.staging

• Reliability Protocol for Relay

  • achieved:
    • [nwaku] started the implementation in nwaku - https://github.com/waku-org/nwaku/issues/2819
  • next:
    • [chat] spec the reliability protocol for relay

• Reliability Protocol for Resource-Restricted Clients

  • achieved:
    • [js-waku] continued with using pool approach for protocols https://github.com/waku-org/js-waku/pull/2047
    • [js-waku] store v3 migration https://github.com/waku-org/js-waku/pull/2036
  • next:
    • [js-waku] complete ongoing efforts
    • [js-waku] get back to offline state handling https://github.com/waku-org/js-waku/issues/2024

• Review MVDS usage and fail path

  • achieved:
    • [chat] Improve MVDS: reset epoch for online users https://github.com/status-im/mvds/pull/5

Milestone - End-to-end reliability protocol §

• End-to-end reliability protocol - PoC
  • achieved:
    • [research] Discovery on e2e reliability and bloom filters. Started working on a POC on a standalone repo.
  • next:
    • [research] move to go-waku and continue with the POC

Milestone - Static Sharding - dedicated shards §

• Sharding peer management and discovery hardening
  • achieved:
    • [nwaku] analyse discv5 performance and possible issues https://github.com/waku-org/nwaku/issues/2810
    • [nwaku] fixed issues forming mesh by DST team https://github.com/waku-org/nwaku/issues/2780 https://github.com/waku-org/nwaku/pull/2824
    • [nwaku] Added small enhancements to the peer manager https://github.com/waku-org/nwaku/pull/2823, https://github.com/waku-org/nwaku/pull/2831
    • [nwaku] Opened PR adding logs requested by DST for discv5 investigation https://github.com/waku-org/nwaku/issues/2841 https://github.com/waku-org/nwaku/pull/2811
    • [nwaku] Opened PR adding peer origin information to the /admin/v1/peers REST endpoint https://github.com/waku-org/nwaku/pull/2848
  • next:
    • [nwaku] continue with discv5 and peer manager investigations
    • [nwaku] Implement a permanent customizable logging solution for nim-libp2p
    • [nwaku] deprecate named sharding

Milestone - Scale 1:1 chat messages PoC §

• RLNv2 in nwaku

  • achieved:
    • [research] Various debugging and bug fixing, executing https://github.com/waku-org/pm/issues/168
  • next:
    • [research] Deliver 0.30.0 with RLNv2 in nwaku

• Maturing RLN variables/parameters revision

  • achieved:
    • [research] RLNv2 debugging, test plan, waku-simulator updates
  • next:
    • [research] RLNv2 release candidate testing

• Provision RLN for light push clients PoC

  • achieved:
    • [research] continued testing of merged feature
  • next:
    • [research] deploy service to existing fleets and dogfood with js-waku

• Pay for RLN provision first PoC

  • achieved:
    • [research] PR for incentivization PoC (without on-chain interaction yet)
  • next:
    • [research] add on-chain interaction to the PoC - txid lookup as proof of payment

Other Work §

Enhancements §

• achieved:
  • [chat] status-go: expose wakuext_enr
  • [chat] use UTC format for geth.log timestamp
  • [chat] use IP addresses instead of dns to store multiaddresses
  • [chat] waku enr decoder tool https://github.com/waku-org/enr-decoder/
  • [js-waku] remove relay dependency https://github.com/waku-org/js-waku/pull/2040

Bugs §

• achieved:
  • [chat] do not write tcp port 0 and remove 100 chars length limit for multiaddresses
  • [chat] fix ctx not available when starting telemetry client
  • [nwaku] Mount Metadata in wakucanary https://github.com/waku-org/nwaku/issues/2720
  • [nwaku] duplicate message forwarding to filter client https://github.com/waku-org/nwaku/issues/2320
• next:
  • [nwaku] peer exchanges return nodes that no longer exist. - https://github.com/waku-org/nwaku/issues/2414