Codex Update Mar 12th - Mar 18th
The Codex team continues to make progress with various initiatives to wrap up the demo for the Q1/Q2 public testnet release. An internal testnet has been running for the past few weeks and has been used to test the latest version of Codex and can be accessed using the Codex Testnet Starter documentation.
Ongoing and new lines of research and development will soon begin in preparation for the next version of Codex that will be used for the mainnet release.. Here are the updates from different team members and their ongoing work. Development is currently broken into three distinct teams:
- Client, Testing, and Infrastructure
- Marketplace
- Research
The different teams have actively moving on various fronts. The following are their team updates to various ongoing Epics.
Client, Testing and Infrastructure
Client
Completed
- Marked PR as ready - scheduling erasure encoding and decoding on a thread pool https://github.com/codex-storage/nim-codex/pull/716
- Put together reasoning on why the profiler works the way it does;
- Closed a bug re: double lookups when block does not exist;
Ongoing
- Started a PR to fix Atlas after SAT integration
- Finishing basic fixes PR in Atlas https://github.com/nim-lang/atlas/pull/120
- Started work on scheduling prover computation on a thread pool
- Fixing comments and rebasing large PRs:
- https://github.com/codex-storage/nim-codex/pull/631
- https://github.com/codex-storage/nim-codex/pull/678
- Work on Frontend
- Implemented dropdown list for expiry input
- Started working on caching node information for displayed information
- Some triaging of bugs in the Codex repo, still some way to go;
Infrastructure
Completed
- ✅ Install VictoriaMetrics in Testnet cluster #130
- ✅ Adjust number of nodes in Testnet cluster #136
- ✅ Redeploy Testnet cluster components #138
- ✅ Install ELK in Testnet cluster #135
Ongoing
Marketplace
Completed
- Discussions about ceremony files retrival
- PR Reviews:
Ongoing
- WIP on merging https://github.com/codex-storage/nim-codex/pull/692
- WIP on persistant availabilities
Research
2024 R&D Goals
1. Proving system and aggregation improvements (folding or lookups)
2. Aggregator/validator design
3. DHT improvements
4. Tokenomics and incentive design
5. Bandwidth incentives
6. Dynamic data (appendable data)
7. Encryption
Completed
- EthResearch post on sampling techniques (https://ethresear.ch/t/lossydas-lossy-incremental-and-diagonal-sampling-for-data-availability/18963)
- DAS simulator (https://github.com/codex-storage/das-research) paper prep (calls + work)
- Shadow based P2P emulator for DAS (https://github.com/cskiraly/dst-gossipsub-test-node/tree/FullDAS)
- Looked into how circom handles custom gates (tldr: it’s easy to abuse for our own purposes, but snarkjs doesn’t implement anything)
- Minor refactor the proof circuit PR
Ongoing
- Started working on prototyping for the new proof system