zkEVM TestNet: Weekly Sync

# zkEVM TestNet: Weekly Sync ``` Project Board: https://github.com/orgs/privacy-scaling-explorations/projects/3/views/1 >> This view displays only issues on repos: zkevm-chain & zkevm-chain-testing, plus assignes (nick,pinkie,leo,marios). ``` # July 27th, 2023. ### Work/issues Completed : - Migrate Testool to GH Actions and make reports publicly available - Integrate p0tion terraform code into aws MACI environment (create modules, data outputs etc) - https://git-codecommit.eu-central-1.amazonaws.com/v1/repos/EFPrivacyScalingInfrasrtucture - Create vpn rule to force all user traffic via tunnel (useful when accessing from regions with accesses restrictionsss) - Create AWS infrastructure and deployment using GH Actions for crypt-keeper (implemented using EC2s due to issues with ECS/Fargate) - Create AWS Fargate infrastructure and support GH Actions deployment for pse website ### Work/Issues In Progress : - Migrate worst case benchmarks from zkevm-chain to zkevm-circuits/integration tests. ONGOING - find a way to remove --ssd-json argument from solc exexution(causes serde json to fail due to json depth exceeding recursion limit). - disable compiler optimizations - Crypt-keeper: Troubleshooting ECS deployment against demo container that fails with inotify/max_user_watches error ### Work/Issues On Hold: ### New Items for Backlog: # June 15th, 2023. ### Work/issues Completed : - bandada: - Create blue/green deployment against Fargate using GH Actions (enhancements) ### Work/Issues In Progress : - Investigation: Logging/Alerting/Monitoring solution for PSE projects ### Work/Issues On Hold: - zkevm: - Investigate GH Actions queued workflows (https://github.com/orgs/community/discussions/55538) ### New Items for Backlog: - POC: Create staging environment + deployment + logging/alerting/monitoring for bandada project # June 1st, 2023. ### Work/issues Completed : - bandada: - Testing/Troubleshooting scaling scenarios using cloudwatch alarms - zkchat: - Create staging environment for zkchat - Create deployment using GH Actions for both prod + stg environments ### Work/Issues In Progress : - bandada: - Create blue/green deployment against Fargate using GH Actions (enhancements) - Investigation: Logging/Alerting/Monitoring solution for PSE projects ### Work/Issues On Hold: - zkevm: - Investigate GH Actions queued workflows (https://github.com/orgs/community/discussions/55538) ### New Items for Backlog: # May 18th, 2023. Closing sprint : xx ### Work/issues Completed : - bandada: - AWS/ECR Code review/Fix issues - Started migration for all containers to Fargate - zkchat: - Migrate dev environment -> prod - PSE: - AWS maintenance/Billing - Cost reduction investigation? ### Work/Issues In Progress : - bandada: - Create blue/green deployment against Fargate using GH Actions - Testing/Troubleshooting scaling scenarios using cloudwatch alarms ### Work/Issues On Hold: - zkevm: - Investigate GH Actions queued workflows (https://github.com/orgs/community/discussions/55538) ### New Items for Backlog: - Create staging environment for zkchat - Investigation: Logging/Alerting/Monitoring solution for PSE projects # May 4th, 2023. Closing sprint : xx ### Work/issues Completed : ### Work/Issues In Progress : - bandada: - AWS/ECR Code review/Fix issues - Started migration for all containers to Fargate - Troubleshooting - zkchat: - Enhancements/Support - zkevm: - Investigate GH Actions queued workflows - PSE: - AWS maintenance/Billing - Cost reduction investigation? ### Work/Issues On Hold: ### New Items for Backlog: # April 27th, 2023. Closing sprint : xx ### Work/issues Completed : ### Work/Issues In Progress : - bandada project: - migrate ec2 (docker) implementation to ecs/fargate - create managed deployment solution for ecs/fargate - create GH Actions worfflows to trigger deployments ### Work/Issues On Hold: ### New Items for Backlog: # March 16th, 2023. Closing sprint : 30 ### Work/issues Completed : - Setup Integration tests with Real prover (Integrate with GitHub-ops) (https://github.com/privacy-scaling-explorations/zkevm-circuits/pull/1319]) - zkgroups: Create deployment pipelines using AWS CodeDeploy ### Work/Issues In Progress : - testing BlankFloorPlanner / https://github.com/privacy-scaling-explorations/halo2/issues/155 - wc block tests for testnet - Bytecode - zkevm-chain: Integrate GH Actions based chain tests with Grafana reporting ### Work/Issues On Hold: - Migrate zkitter to PSE AWS account (infrastructure setup finished - deployment/final migration on hold until new version of zkitter release) - zkevm-circuit benchmarks: Implement CI Alerts and send Notifications to discord (https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1133#event-8428306209) ### New Items for Backlog: - Blue/Green (0 downtime) deployments (will be used first in zk-groups and then to other PSE projects ) - Devops Enhancements (AWS + ansible playbooks) - Backup/Sync GH repos to AWS S3 (storage classes TBD) # March 9th, 2023. Closing sprint : 29 ### Work/issues Completed : - Integration Tests with real prover: New functionalities merged on demand and scheduled workflow runs - https://github.com/privacy-scaling-explorations/zkevm-circuits/pull/1297 - https://github.com/privacy-scaling-explorations/zkevm-circuits/pull/1290 ### Work/Issues In Progress : - testing BlankFloorPlanner / https://github.com/privacy-scaling-explorations/halo2/issues/155 - Setup Integration tests with Real prover (Integrate with GitHub-ops) - wc block tests for testnet - Bytecode - zkgroups: Create deployment pipelines using AWS CodeDeploy - zkevm-chain: Integrate GH Actions based chain tests with Grafana reporting ### Work/Issues On Hold: - Migrate zkitter to PSE AWS account (infrastructure setup finished - deployment/final migration on hold until new version of zkitter release) - zkevm-circuit benchmarks: Implement CI Alerts and send Notifications to discord (https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1133#event-8428306209) ### New Items for Backlog: # March 2nd, 2023. Closing sprint : 28 ### Work/issues Completed : - EvmCircuit/RootCircuit bug | https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1233 - [public input contract issue](https://github.com/privacy-scaling-explorations/zkevm-chain/issues/128) - misc improvements in zkevm-chain - Refactoring Terraform code for PSE AWS - Integrate AWS with GitHub Actions in order to deploy CI/CD pipeline to AWS resources (POC done) ### Work/Issues In Progress : - testing BlankFloorPlanner / https://github.com/privacy-scaling-explorations/halo2/issues/155 - Migrate zkitter to PSE AWS account - Setup Integration tests with Real prover (environment + scheduled pipelines + reporting) - wc block tests for testnet - Bytecode - zkevm-circuit benchmarks: Implement CI Alerts and send Notifications to discord (https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1133#event-8428306209) ### New Items for Backlog: - zkgroups: Create deployment pipelines using AWS CodeDeploy # February 23rd, 2023. Closing sprint : 27 ### Work/issues Completed : - Migrate zkgroups to PSE AWS account - Integrate zkevm-circuits/benchmarks with grafana results reporting >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/26 ### Work/Issues In Progress : - Setup Integration tests with Real prover (environment + scheduled pipelines + reporting) - wc block tests for testnet - Bytecode - zkevm-circuit benchmarks: Implement CI Alerts and send Notifications to discord (https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1133#event-8428306209) - Migrate zkitter to PSE AWS account - Refactoring Terraform code for PSE AWS - [RootCircuit debugging](https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1233) - [split _validatePatriciaProof into dedicated functions](https://github.com/privacy-scaling-explorations/zkevm-chain/issues/20) ### New Items for Backlog: - Integrate AWS with GitHub Actions in order to deploy CI/CD pipeline to AWS resources ### Blocking Issues: ### Other Notes/Action Items/Remarks - Nick Off (27-28/02) - Marios Off (27/02) # February 16th, 2023. Closing sprint : 26 ### Work/issues Completed : - Apply merge queue to zkevm-circuits (https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1210#event-8526212256) - CI improvements & integrating zkevm-circuit changes like the RootCircuit - dev environment (zk proof generator) for eigen-trust project - Make test tool reports available to scroll (https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/28 ### Work/Issues In Progress : - Setup Integration tests with Real prover (environment + scheduled pipelines + reporting) - wc block tests for testnet - Bytecode - Integrate zkevm-circuits/benchmarks with grafana results reporting >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/26 - zkevm-circuit benchmarks: Implement CI Alerts and send Notifications to discord (https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1133#event-8428306209) - Migrate zkitter to PSE AWS account ### New Items for Backlog: - work for the next milestone - zkevm-circuits: https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/370 - zkevm-circuits: focus on proper padding config / soundness issues - zkevm-chain: old issues on our project board: - https://github.com/privacy-scaling-explorations/zkevm-chain/issues/101 - https://github.com/privacy-scaling-explorations/zkevm-chain/issues/42 - https://github.com/privacy-scaling-explorations/zkevm-chain/issues/40 - https://github.com/privacy-scaling-explorations/zkevm-chain/issues/20 - evaluating scroll techs halo2 gpu support - Triggering of TA pipelines - skip if no merge >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/22 testing/issues/25 - wc block tests for testnet - Keccak & Tx # February 10th, 2023. Closing sprint : 25 ### Work/issues Completed (current sprint): - Integrate zkevm-circuits/benchmarks with grafana results reporting >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/26 - Deploy ephemeral runners in multiple availability zones (https://github.com/privacy-scaling-explorations/github-ops/pull/3) - Integrate zkevm-circuits/benchmarks with grafana results reporting >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/26 ### Work/Issues In Progress (current sprint): - Setup Integration tests with Real prover (environment + scheduled pipelines + reporting) >> https://github.com/privacy-scaling-explorations/zkevm-chain- - wc block tests for testnet (Bytecode & Tx) - Improve CI Checks with git-ops (https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1131) (implemented, draft p) (https://github.com/privacy-scaling-explorations/zkevm-circuits/pull/1145) - - zkevm-circuit benchmarks: send notifications to discord ### New Issues for current sprint: - dev environment (zk proof generator) for eigen-trust project ### New Items for Backlog: - Triggering of TA pipelines - skip if no merge >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/22 testing/issues/25 - devops support for either zkitter or zk-groups (migration to aws from other cloud provider and ci implementation) ### Blocking Issues: ### Other Notes/Action Items/Remarks # February 3rd, 2023. Closing sprint : 24 ### Work/issues Completed (current sprint): - BLS Wallet Migration to AWS ### Work/Issues In Progress (current sprint): - Integrate zkevm-circuits/benchmarks with grafana results reporting >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/26 WIP: https://grafana.zkevm-testnet.org/d/vofy8DAVz/circuit-benchmarks?orgId=1&var-test_id=EVM-19-Benchmark-PR1_739839&from=1675370401000&to=1675372201000 - Improve CI Checks with git-ops (https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/1131) - Worst case block tests ### New Issues for current sprint: ### New Items for Backlog: - zkevm-circuit benchmarks: send notifications to discord - Triggering of TA pipelines - skip if no merge >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/22 - Setup Integration tests with Real prover (environment + scheduled pipelines + reporting) >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/25 ### Blocking Issues: ### Other Notes/Action Items/Remarks # January 26th, 2023. Closing sprint : 23 ### Work/issues Completed (current sprint): - Reporting benchmark & integration test results (zkevm-chain e2e) >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/21 (https://github.com/privacy-scaling-explorations/zkevm-chain-testing/pull/24) sample : https://grafana.zkevm-testnet.org/d/eBJJvio4k/zkevm-chain-tests-dev?orgId=1&var-test_id=proveSingeCrossChainTx314&from=-6826919777871&to=-6826915037871 ### Work/Issues In Progress (current sprint): - Worst case block tests - Triggering of TA pipelines - skip if no merge >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/22 - Nick - Create new env & migrate bls-wallet to PSE AWS account - Implement GH actions for bls-wallet deployments - Implement Logging and monitoring solution ### New Issues for current sprint: - Setup Integration tests with Real prover (environment + scheduled pipelines + reporting) >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/25 - Integrate zkevm-circuits/benchmarks with grafana results reporting >> https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/26 ### New Items for Backlog: ### Blocking Issues: ### Other Notes/Action Items/Remarks # January 19th, 2023. Closing sprint : 22 ### Work/issues Completed (current sprint): - Nick - Deploy and configure instance+DB for benchmark results storage - Tables schema definition - DB Integration with Grafana - Create a tool that migrates an EC2 instance to a different Availability Zone - Devops - Technical analysis for PSE project requirements: - zk-groups - zkitter - bls-wallet - Marios - Reporting benchmark & integration test results ### Work/Issues In Progress (current sprint): - Nick - Implement alert mechanism for failed CI/CD executions from Grafana to Discord (implemented and tested to a dummy discord server - Grafana alerts for pipelines needs some fine tuning) - Marios - Implement ram and cpu stats reports (grafana) for benchmarks and integration tests - Worst case block tests ### New Issues for current sprint: - Nick - Create new env & migrate bls-wallet to PSE AWS account - Implement GH actions for bls-wallet deployments - Implement Logging and monitoring solution ### New Items for Backlog: ### Blocking Issues: ### Other Notes/Action Items/Remarks # January 12th, 2023. Closing sprint : 21 ### Work/issues Completed (current sprint): - Devops - Create Jenkins pipelines (+infrastructure) - Nightly run: generate proofs for simple eth transfer transaction - Weekly run: worst case benchmarking for evm/state/keccak ### Work/Issues In Progress (current sprint): - Marios - working on a django backend for saving benchmark results (https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/16) - Nick - Deploy and configure instance+DB for benchmark results storage - Tables schema definition - DB Integration with Grafana ### New Issues for current sprint: - Devops - Technical analysis for PSE project requirements: - zk-groups - zkitter - bls-wallet - Implement alert mechanism for failed CI/CD executions from Grafana to Discord - Marios - Implement worst case benchmarks for remaining circuits ### New Items for Backlog: ### Blocking Issues: ### Other Notes/Action Items/Remarks # January 5th, 2023. Closing sprint : 20 ### Work/issues Completed (current sprint): - Marios - working on keccak circuit worst case benchmarks >> merged to main (https://github.com/privacy-scaling-explorations/zkevm-chain-testing/pull/15) - brownie support for pre-compiled contracts (https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/17) - Nick - Jenkins scripts refactoring - Implement AWS IAS for short-lived credentials - Implement support for spot instances using the IAM role for ephemeral GitHub runners ### Work/Issues In Progress (current sprint): - Marios - working on a django backend for saving benchmark results (https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/16) - Devops - Create Jenkins pipelines (+infrastructure) ### New Issues for current sprint: - Devops - Migrate expensive AWS resources to cheaper zone - Nick - Deploy and configure instance+DB for benchmark results storage ### New Items for Backlog: - Nick - Create OpenLDAP replica - Use OpenLDAP to authenticate OpenVPN users ### Blocking Issues: ### Other Notes/Action Items/Remarks # December 15th, 2022. Closing sprint : 17 ### Work/issues Completed (current sprint): - DevOps - Budget planning/forecast for PSE cloud needs - 2023 - Nick - Test Pinkies' CI implementation for multiple self hosted runners and implement short-lived credentials to access AWS resources (GH Part: https://github.com/ntampakas/github-ops/tree/short-lived-cred) ### Work/Issues In Progress (current sprint): - Nick - Investigation/Troubleshooting: GH Actions: Why workflow jobs API does not get info from all queued jobs and if there' s a different way to retrieve jobs info - SPT - Marios - working on keccak circuit worst case benchmarks (https://github.com/privacy-scaling-explorations/zkevm-chain-testing/pull/15) - working on a django backend for saving benchmark results () ### New Issues for current sprint: - Devops - Create Jenkins pipelines (+infrastructure) - Nick - Jenkins scripts refactoring - Implement IAS, the AWS part for short-lived credentials ### New Items for Backlog: ### Blocking Issues: ### Other Notes/Action Items/Remarks - Nick - Off from 22.12.2022 - 31.12.2022 (reachable on telegram) # December 8th, 2022. Closing sprint : 16 ### Work/issues Completed (current sprint): - Nick - [Prepare Documentation for Jenkins custom environment](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/9) - [Add diff from previous commit to Jenkins Testool under Reports](https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/913) - Pipeline created for nightly build - Pair working with Marios to finalize circuit bench jobs/scripts in Jenkins - Investigation: Run self hosted environments on Kubernetes cluster - Investigation: How to access securely AWS resources from Github Actions ### Work/Issues In Progress (current sprint): - pinkie - Working on faster & more automatic CI - https://github.com/privacy-scaling-explorations/zkevm-chain/pull/109 - https://github.com/privacy-scaling-explorations/github-ops - Nick - SPT - Marios - Prepare SCs for worst case blocks generation ### New Issues for current sprint: - DevOps - Budget planning/forecast for PSE cloud needs - 2023 - Marios - Start working on backend service to aggregate benchmark results - Nick - Test Pinkies' CI implementation for multiple self hosted runners and implement short-lived credentials to access AWS resources ### New Items for Backlog: ### Blocking Issues: ### Other Notes/Action Items/Remarks # December 1st, 2022. Closing sprint : 15 ### Work/issues Completed (current sprint): - Nick - [Clone & adapt zkEvmChainTesting_deploy job to support custom environments](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/8) - [Implement/Adapt scripts to support new version of Testautomation Framework](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/10) - Prepared documentation for TA environment usage - https://hackmd.io/582Logt_TH-1FBnaEs9zHA?view - Marios - Finished preparation for TA tool demo - Benchmarks for https://github.com/privacy-scaling-explorations/zkevm-chain/commit/05f7a6f3b363d14677bc4e725335c551b09447a7 >> https://discord.com/channels/1035582816488013904/1045383445796368404 - Troubleshooting ci issues (OOM, actions runner service hanging) - pinkie - Working on proving aggregated super circuit - ci issues basically - Fixing some minor bugs along the way to prove super circuit succesfully ### Work/Issues In Progress (current sprint): - Nick - [Prepare Documentation for Jenkins custom environment](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/9) - [Add diff from previous commit to Jenkins Testool under Reports](https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/913) - Marios - Preparing tests for worst case blocks benchmarks - https://github.com/orgs/privacy-scaling-explorations/projects/3/views/8 - benchmarking https://github.com/privacy-scaling-explorations/zkevm-chain/commit/0289a2306069622f7166aee5770bb9c949a1da68 - Do TA tools presentation ### New Issues for current sprint: - Nick/Marios - Investigation: [Implement multiple ci-runners (self hosted) for parallel ci-actions execution](https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/957) ### New Items for Backlog: - Nick - [Create Pipelines to automate and schedule jobs in Jenkins](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/13) ### Blocking Issues: ### Other Notes/Action Items/Remarks # November 24th, 2022. Closing sprint : 14 ### Work/issues Completed (current sprint): - Nick - [GH Actions: Integration tests workflow not working as expected](https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/928) - Marios - First Release of TA test code - pinkie: - [pcs for l1 bridge](https://github.com/privacy-scaling-explorations/zkevm-chain/pull/94) ### Work/Issues In Progress (current sprint): - Nick - [Clone & adapt zkEvmChainTesting_deploy job to support custom environments](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/8) - [Implement/Adapt scripts to support new version of Testautomation Framework](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/10) - Marios - Working with Nick on TA Framework demo preparation ### New Issues for current sprint: - Nick - [Prepare Documentation for Jenkins custom environment](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/9) - [Add diff from previous commit to Jenkins Testool under Reports](https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/913) - Marios - Need to repeat all previously failing benchtests ### New Items for Backlog: - ToDo: Create Issues in Backlog for zkEVM-chain-testing repo for Worst case Blocks(write SCs for appropriate opcodes depending on circuit and calculate worst case blocks, adapt brownie accordingly) [https://hackmd.io/aYwf08DURDKbmgO_qVpjCQ] - ToDo: Create issues in backlog for medium block proof benchmarking (write/deploy an ERC-20 Contract) ### Blocking Issues: ### Other Notes/Action Items/Remarks # November 17th, 2022. Closing sprint : 13 ### Work/issues Completed (current sprint): - Marios: - prover benchmarks for EVM/STATE worst case block for : zkevm-chain commit : b739d5057d56485da4c5164bf88ed20ed324df43 Results here: https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/790 - Nick - [Implement instance provision and manipulation withing Jenkins](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/5) - [Integrate & test instance provision and manipulation to a new Jenkins job](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/6) - [Clone & adapt zkevm-chain_deploy job to support custom environments](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/7) - pinkie - Update pi commitment contract to match zkevm-circuit https://github.com/privacy-scaling-explorations/zkevm-chain/pull/91 - fixing issues with aggregation circuit: https://github.com/privacy-scaling-explorations/zkevm-chain/pull/93 ### Work/Issues In Progress (current sprint): - Marios: - Preparing first release of TA framework (Jenkins+brownie) - Nick - [Clone & adapt zkEvmChainTesting_deploy job to support custom environments](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/8) ### New Issues for current sprint: - Marios - Prepare Demo TA framework - Nick - [Add diff from previous commit to Jenkins Testool under Reports](https://github.com/privacy-scaling-explorations/zkevm-circuits/issues/913) ### New Items for Backlog: - ToDo: Create Issues in Backlog for zkEVM-chain-testing repo for Worst case Blocks(write SCs for appropriate opcodes depending on circuit and calculate worst case blocks, adapt brownie accordingly) [https://hackmd.io/aYwf08DURDKbmgO_qVpjCQ] - ToDo: Create issues in backlog for medium block proof benchmarking (write/deploy an ERC-20 Contract) - ToDo: [????] Create backlog items for https://discord.com/channels/1035582816488013904/1042373546925633576 - [Prepare Documentation for Jenkins custom environment](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/9) ### Blocking Issues: ### Other Notes/Action Items/Remarks # November 10th, 2022. Closing sprint : 12 ### Work/issues Completed (current sprint): - pinkie: - [Configuration options for prover/coordinator](https://github.com/privacy-scaling-explorations/zkevm-chain/pull/81) - [Implement e2e coverage report for l1&l2 contracts](https://github.com/privacy-scaling-explorations/zkevm-chain/pull/85) - nick: - [Jenkins users authentication](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/4) - Marios: - review and testing of https://github.com/privacy-scaling-explorations/zkevm-chain/pull/81 - Troubleshooting issue with coordinator stall after failure to get l1 block event logs >> Issue is on simulated client after all (incorrent bridge method call) but Pinkie's hack (https://github.com/privacy-scaling-explorations/zkevm-chain/pull/88) treats an actual geth race condition - Prepared cloud environment for Itegration tests with real prover ### Work/Issues In Progress (current sprint): - pinkie: - [Update InstanceVerifier to latest spec](https://github.com/privacy-scaling-explorations/zkevm-chain/issues/78) - Upgrade of zkevm circuits - [`eth_getLogs` inconsistencies](https://github.com/privacy-scaling-explorations/zkevm-chain/pull/88) - nick: - [Implement instance provision and manipulation withing Jenkins](https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/5) - Marios: - https://github.com/privacy-scaling-explorations/zkevm-chain-testing/issues/1 - Execute proof benchmarks for latest zkevm-chain release (a296697ce2a7bc43f9fbc89b762ba954c831a6c0)#17 - Troubleshooting various errors during chain tests: - Proof fails with `Err` value: NotEnoughRowsAvailable { current_k: 20 }" > when **aggregate: true**. Coordinator panicks, does not send proofRequests for subsequent blocks - Mock Prover reports **task_result: Ok** for otherwise failed block - ### New Issues for next sprint: - Jenkins Ethereum-tests Demo. Will do early next week ### New Items for Backlog: ### Blocking Issues: - pinkie: - super circuit still broken (ongoing) ### Other Notes/Action Items/Remarks - We have a new zkEVM discord server here: https://discord.gg/tpAxWRSJ. There is a dedicated "Testnet" channel, so we can use it for chatting purposes.