2023-11-03 Codex weekly

Codex Update Oct 24th - Nov 3rd §

The team is working towards deploying a beta testnet by the end of the year, and most work is centered around finishing all the required functionality for that.

Client §

Epic: Block Merkelization §

• Merkelization concrete PR in review
  • https://github.com/codex-storage/nim-codex/pull/566
    • Unifying the flows
    • Making treeCid to be the same as treeRoot
    • Storing proofs in key/value storage

Epic: Wiring the Proving System §

• Work on storage proofs is ongoing in https://github.com/codex-storage/codex-storage-proofs-circuits
• Work on Poseidon2 is being done in - https://github.com/codex-storage/nim-poseidon2

Epic: Improve Client Stability §

• Explored using CI flow for cloud-based benchmark harness, settled on Packer for image scripts Packer scripts - private repo
• Simple logging filtering/merging tool: logtools
• Microbenchmark of Sql backend in two separate VMs
• Ran remaining benchmarks, summary at Benchmark Summary
• Exploring behavior of nim-datastore and sqlite
• Continued working on a “quick-and-dirty” test setup, managed to get it working
• Quick PoC for a codex net deployed with Terraform on VMs: Terraform main.tf
• Async Profiling

Marketplace §

Epic: End-to-end Testing §

• Further work on multinode integration testing
  • prevent stuck transactions by async locking nonce sequencing (+ estimate gas)
  • On transaction failure, fetch revert reason with replayed transaction
  • Support logging to file
  • [fix] Ensure AsyncLock is released in case of exception
• feat: ensure block expiry

Infra §

• Created Testnet Kubernetes cluster 56
• Deployed Testnet cluster basic components 57
• Configured DNS name for Testnet cluster 76
• Created Service Accounts in Testnet cluster 77
• Checked CORS issue on Codex Demo 79
• Configured TCP/UDP port forwarding for Testnet deployment 80