2025-09-29 Codex weekly

Week 39 September 2025 §

Replace bittorrent in status-go §

1. BlockExchange Performance and reliability

   • achieved:
     • Analyzed memory scaling revealing significant growth from message buffer allocation
     • Optimized block batch size achieving substantial memory reduction with minimal performance impact across networks scenarios
     • Characterized performance vs memory trade-offs across different batch configurations and validated through multi-peer testing
   • next:
     • Investigate request batching optimization
     • Run performance tests on Kubernetes cluster for distributed workload validation
   • blockers:

2. Identify Swarm Participation Limits (DHT Scaling)

   • achieved:
     • Refined the document, calculations, and figures to address the review comments.
     • Documented the findings and concluded this research for the time being and will revisit it in the future if needed.
     • PR for the outcome of this research closed and merged.
   • next:
   • blockers:

3. Implement a Codex library so that clients can use Codex directly from their apps

   • achieved:
     • Implemented a file path upload API
     • Added an onProgress API to track upload progress from the Go application
     • Began development of the download feature
     • Addressing thread pointer issues causing segmentation faults
   • next:
     • Finalize the upload API implementation
     • Extend functionality to fetch manifests
     • Add support for block deletion
   • blockers:

4. Integration with status-go

   • achieved
     • first draft of the new history publishing flow (code: status-go/pull/6930, ongoing-docs: codex-docs-obsidian/pull/19):
       • creating and publishing individual archives to Codex
       • updating and publishing the corresponding index file to Codex
       • maintaining compatibility with BitTorrent magnet links:
         • the CID of the index is published on the same channel as magnet link in separate message
         • torrent file is seeded + CID of the new index is advertised via Codex - if one of them succeeds publishing of the history is considered successful
       • compiles but not tested
   • next:
     • add database migrations for the new Codex specific community archive info attributes (like last_index_cid and index_cid_clock),
     • archive download flow
   • blockers:

Research future work §

1. Altruistic Mode
   • Ongoing work in (re-)analysing Arweave, Sia, and Walrus based both on previous research done in the group (students and departed members), and more recent publications as we rebuild our knowledge on related approaches.
   • Document: Analysis of decentralized storage networks which revisits pervious research and extends our knowledge of Arweave and Sia.
   • Document: Summary of our findings on th WALRUS Storage Protocol.