2024-07-15 Waku Weekly

Milestone - Store Service Upgrade §

• Store v3-beta - Message Hashes

  • achieved:
    • [research] improved migration script & migration tests
  • next:
    • [research] storev3 benchmark test plan

• DOS protection for req-res protocols and metrics

  • achieved:
    • [nwaku] BW metrics per shard: implemented per shard metric collection feat: Proper bandwidth metrics per shard
    • [nwaku] Added dashboard panels for relay per shard traffic
    • [nwaku] Added dashboard panels for non-relay protocols data traffic
    • [nwaku] Added dashboard panels for non-relay protocols request rates
    • [nwaku] Finished and under review: feat: DOS protection of non relay protocols - rate limit phase3
    • [nwaku] Added per peer filtering of high users
    • [nwaku] Load balancing compensation applied to token replenish
    • [nwaku] Filter service specific limits for ping and subscribe per peer
  • next:
    • [nwaku] Separate add distinction between gross/net inbound traffic of shards.

• PostgreSQL Maintenance

  • achieved:
    • [nwaku] Designed and implemented the first version of the Sonda tool chore: create sonda tool, which is about to open for review.
    • [nwaku] Better partition creation approach to avoid database AccessExclusiveLock - fix: postgres_driver - better partition creation without exclusive access
  • next:
    • [nwaku] Get Sonda reviewed and implement feedback
    • [nwaku] Tackle the following so that the cursor bug is fulfilled chore(archive): archive and drivers refactor

Milestone - Direct Message Reliability §

• Enable testing of direct messages

  • achieved:
    • [chat] chore: allow cli to run on a different fleet

• Review connection management strategy and back-off and fix long disconnection issues

  • achieved:
    • [chat] refactor: ping a subset of connected peers, feat: bump go-waku to introduce new keep alive interval
    • [chat] feat: wakuext_relayPeersByTopic
    • [chat] fix: missing messages delay should be substracted
    • [chat] feat: use mesh peers instead of all peers for determining topic health

• Reliability Protocol for Relay

  • achieved:
    • [chat] refactor and merge the spec for relay reliability feat: reliability for relay protocol

• Reliability Protocol for Resource-Restricted Clients

  • achieved:
    • [js-waku] RFC clarifications Add “req-res protocol reliability” spec
    • [js-waku] peer cycling complete feat: peer management for protocols (with disconnection management)
  • next:
    • [nwaku] Implement: feat: Enhance lightpush protocol error handling

• User apps for large scale dogfooding

  • blockers:
    • [js-waku] waiting for release of nwaku 0.30.2

• Review MVDS usage and fail path

  • achieved:
    • [chat] summarize the message types that are using MVDS

Milestone - End-to-end reliability protocol §

• End-to-end reliability protocol - PoC
  • achieved:
    • [research] raised a draft PR for e2e reliability POC in go-waku with new message structure, lamport timestamp, bloom filter, buffer and sync
  • next:
    • [research] ACK handling, request missing messages, resend message

Milestone - Static Sharding - dedicated shards §

• Sharding peer management and discovery hardening
  • achieved:
    • [nwaku] investigating connectivity issues. Decreased connectivity loop interval chore: setting connectivity loop interval to 30 seconds
    • [nwaku] final checks and deprecating named sharding chore: deprecating named sharding
  • next:
    • [nwaku] Refactor code now that named sharding is removed, and deprecate pubsub-topic configuration

Milestone - Scale 1:1 chat messages PoC §

• RLNv2 in nwaku

  • achieved:
    • [research] Completed milestone shipping RLNv2 and stateless light clients: [Epic: Dogfooding] Deliver RLN v2 + RLN in resource-restricted to The Waku Network

• Maturing RLN variables/parameters revision

  • achieved:
    • [research] Blog post announcing the new feature: Post RLN-V2 + Stateless Light Clients
    • [research] completed RLNv2 e2e testing
  • next:
    • [research] Some work with go-waku-light to showcase stateless light clients in The Waku Network
    • [research] Conference presenting Waku poster

Other Work §

Enhancements §

• achieved:
  • [nwaku] bumped vendor dependencies for v0.31.0. Start using Nim 2.0.8 - chore: Bump dependencies for v0.31.0
  • [chat] refactor: remove namedsharding usage in status-go refactor: only use shards
  • [chat] fix : filter uninstall and reinstall issue in status-go fix: don’t resubscribe filters unless there is a change in shard for community

Bugs §

• achieved:
  • [nwaku] bug: peer exchange returns nodes that no longer exist
• next:
  • [nwaku] bug: failed to retrieve peer info via peer exchange protocol