owned this note
owned this note
Published
Linked with GitHub
Please all track leaders do a bit of issue grooming and assign good first issue labels to appropriate tasks. There is interest from potential contributors.
Tracks sync 09.03.2020
=======
## Core Track (Janoš)
- testing infrastructure
- preparation for mallorca (submit new entries for agenda)
- BEE Project
## Communication Track (Vojtěch)
(absent)
## Pinning (Viktor)
- zahoor working on PR (link?)
## Book of Swarm track (Viktor)
- working on diagrams
- Rewrite feed chapter
- Worked with Rinke on revising lottery part
- Going to create entry for Mallorca about APIs
## Incentives (Rinke, Marcelo)
- Queue PR open (https://github.com/ethersphere/swarm/pull/2124)
- Logger PR merged (https://github.com/ethersphere/swarm/pull/2119)
- Outstanding in current sprint: [Network ID](https://github.com/ethersphere/user-stories/issues/63), [bounced cheques](https://github.com/ethersphere/user-stories/issues/72)
## Business (Gregor)
- swarm was present @ETHCC with 2 talks
- Developer update newsletter
- Proposing to have somebody responsible per track for updates
## Devops (Svetomir)
- Mallorca
- Testing infrastructure
Tracks sync 02.03.2020
=======
## Incentives (Rinke, Marcelo)
- Unify variables types PR ([part III](https://github.com/ethersphere/swarm/pull/2085) ready for review, part IV awaiting III)
- Mallorca submission (Rinke). [participate](https://docs.google.com/forms/d/1ywxg5qGg3PWr8AiPPCtf0qWzQjYZu7mo-YM2fF6jbMM/edit)
- [SWAP logger](https://github.com/ethersphere/swarm/pull/2119) to-be-merged
Tracks sync 24.02.2020
=======
## Core Track (Janoš)
- new chunk store - fixing an issue with ??? regarding the garbage collector
- continuing hive integration
## Communication Track (Vojtěch)
- updating libp2p to newest version - a lot of changes
- https://github.com/orgs/rsksmart/projects/7
## Pinning (Viktor)
- starting with single owner chunk implementation
## Book of Swarm track (Viktor)
- a lot of progress diagrams (swarm hash, postage stamps), kademlia explanation
- plan is to consolidate and start writing the specs soon
- EDCON has been canceled, we should find alternative event to announce the book
## Incentives (Rinke, Marcelo)
- beginning to implement agile workflow
- part of the team still reading the book of swarm
- PRs that Ralph submited - racing conditions
- [#2112](https://github.com/ethersphere/swarm/pull/2112)
- [#2106](https://github.com/ethersphere/swarm/pull/2106)
## Business (Gregor)
- first draft of the status of association - needed for creating Swiss association
- Community management
- a lot of updates
- events, colaboration with partners, campaigns etc
- collaboration with AIBC
## Devops (Svetomir)
- deployed everything in the new production cluster, waiting for sync
- once synced the old cluster will be shyt down
- Svetomir will present some updates tomorrow at the roundtable
Tracks sync 17.02.2020
=======
## Core Track (Janoš)
- finished the initial backs for protocols
- retrieval protocol as PR
## Communication Track (Vojtěch)
- juraj started to work on a sync protocol (due to no msg persistence)
## Pinning
- started to experiment with single owner chunks see [epic #58](https://github.com/ethersphere/user-stories/issues/58)
## Book of Swarm track (Viktor)
- merged protocols part, added handshake and hive protocol
- call with 3 ppl from IOVlabs on Friday
- added color coding for the state of writeups
- need a lot of help with the diagrams
## Incentives (Marcelo, Vojtěch)
- meeting about SWAP architecture within `bee`
- finished talking about the Survey results
- Ralph finished PR about transaction queue
- unifying variable type still in progress
- meeting about incentivised testnet
## Business (Viktor)
- positive feedback from ETClabs about the token sale
- good meeting with Midhub they are supporting us
- Gregor and Fatim has finalised the papers for association
## Devops (Svetomir)
## External communications
- blog about pinning
Tracks sync 10.02.2020
=======
## Core Track (Janoš)
- work on swarm 0.6.0 version
- 0.5.6 released/deployed
- hive being worked on
- interfaces for kademlia/usage of pot/move code from swarm to bee
- more/improved tests
- tracing is trying to be added
## Communication Track (Vojtěch)
(absent)
## Book of Swarm track (Viktor)
- kademlia table section being worked on by Dani
- completing the vision part
## Research (Daniel, Viktor)
- topic about the book might be brought up during next office hours
## Incentives (Marcelo, Vojtěch)
- results for incentives track survey are being shared and discussed
- book of swarm is continued to be reviewed
- merged support to state store PR
- unify variables pt 3 and refactor backend PRs still in progress
## Business (Viktor)
- interview with potential PO
## Devops (Svetomir)
- helping elad out with deployment
- work on AWS accounts
- continue with deployment of k8s clusters to terraform
- next week cluster can be migrated
- need more input about the chart
Tracks sync 03.02.2020
=======
## Core Track (Janos)
- working on protocol writeup, this can hopefully later on be included in the book
- key handeling for [bee repo](https://github.com/ethersphere/bee)
## Communication Track (Vojtech)
- updating libp2p to async/awaid from callbacks
## Book of Swarm track (Viktor)
- going ahead with Rinke
- idea is to open the book to everyone
- communications still needs to be written
## Research (Daniel, Viktor)
- no update, probably will have a token writeup today by Dani
## Incentives (Marcelo, Vojtech)
- continuing to work on the testnet metrics
- this tuesday we will have presentation how we envision the sprint organisation
## Business (Viktor)
- no update
Tracks sync 27.01.2020
=======
## Core Track (Janos)
- Continuing with libp2p experimental implementation github.com/janos/bee, a bit behind with testing, actively working on abstriction, Petar will start hive protocol, Elad retrieval protocol
- problem with current Swarm - requesting ENS queries for old hashes
- next Swarm release supposed to happen today, somewhen this week
## Communication Track (Vojtech)
- Waiting for libp2p rewrite callbacks to promisses
- Added RSA key support
## Book of Swarm track (Viktor)
- Timeline is to finish reviews at the end of February, public end of March
- next steps is to cut down verbosity and add diagrams
## Ethereum state on Swarm Track (Viktor)
- Paused
## Research (Daniel, Viktor)
- focus on the book
## DevOps (Svetomir)
- preparing infrastructure for bee implementation, writing helms chart
- going to write all the guides on how to run the infrastructure
## Incentives (Fabio, Vojtech)
- documentation for SWAP, should be merged today, this will include some basic deployment as well
- work is being done on cheque edge cases & other parts of the swap go code
- behavior for swap-enabled nodes on rsk testnet is being observed
- research/book of swarm is being reviewed
## Business (Viktor)
- veru joined the team, working on funding the association in Switzerland and Swarm token
Tracks sync 20.01.2020
=======
## Core Track (Viktor, Janos)
- Experimenting with libp2p (Petar, Elad & Janos) github.com/janos/bee
- Elad working on next minor release
## Communication Track (Vojtech)
- Changed focus from incentives to replacing comms layer for Lumino node (Raiden fork). This will make the adoption of the network much easier as every lumino node will be communications node. We will do the same for the RSK client but probably while tackling incentives already
- Reading the Swarm book
## Adaptive Node Track (Viktor)
## Specifications Track (Viktor)
## Ethereum state on Swarm Track (Viktor)
## Research (Daniel, Viktor)
- Working on the book
## DevOps (Svetomir)
- Preparing the infrastructure for the more complex testing - more structured and implementation agnostic
## Incentives (Fabio, Vojtech)
- Marcelo & Ralph - making SWAP more robust through multiple PRs, some still in progress
- Rinke - the book of swarm review & research feedback
- Fabio - incentivization readthedocs documentation
- Santi - testnet metrics: checking out matfix, grafana etc, results will be shared through a doc
## Business (Viktor)
Tracks sync 23.12.2019
=======
## Core Track (Viktor, Janos)
- work continued on better CMD user experience
- general error handling improvements
## Communication Track (Vojtech)
## Adaptive Node Track (Viktor)
## Specifications Track (Viktor)
## Ethereum state on Swarm Track (Viktor)
## Research (Daniel, Viktor)
## DevOps (Rafael)
## Incentives (Fabio, Vojtech)
- PR opened which affects p2p/protocols: https://github.com/ethersphere/swarm/pull/2051 Check before applying balance change
- Scripts for swap-enabled cluster simulations ready and demoed
- Board updated and tickets prioritized
## Business (Viktor)
Tracks sync 16.12.2019
=======
## Core Track (Viktor, Janos)
- Chunk storage low level PR, requirese optional migration https://github.com/ethersphere/swarm/pull/2017
- This week:
- work started on better CMD user experience, this should improve testing and code practices
- finishing protocol package PR https://github.com/ethersphere/swarm/pull/2018
- general error handling improvements
## Communication Track (Vojtech)
- demo at laBITconf using libp2p with forwarding kademlia and super simple [UI](https://rif-comms.netlify.com/)
- decided to continue building both UI and node code. The UI should help drive the needs for the developers who want to use the Comms infrastructure
- next steps are to focus on incentives
## Adaptive Node Track (Viktor)
## Specifications Track (Viktor)
## Ethereum state on Swarm Track (Viktor)
- no progress
## Research (Daniel, Viktor)
- full time spent on writing the book
- rinke on the way to budapest to help
- aiming to have the main structure/ideas of the book ready by the end of year
- dani has uploaded the user story about upload and postage stamps
## DevOps (Rafael)
## Incentives (Fabio, Vojtech)
- finalized the testing infrastructure - now it is possible to spawn cluster from any commit, it uses shared ganache with prefunded wallets of both ETH and ERC20 tokens
- next focus probably postage stamps
## Business (Viktor)
- not much progress
- call with EF on thursday
Tracks sync 09.12.2019
=======
## Core Track (Viktor, Janos)
- fcds (forky) integration and migration (import/export)
- async protocol message handling (involves correct error handling, preparations for blacklisting)
- PR will hopefully be ready soon
- infrastructure documentation update
- work is being done on the book of swarm
## Communication Track (Vojtech)
## Adaptive Node Track (Viktor)
## Specifications Track (Viktor)
## Ethereum state on Swarm Track (Viktor)
- No movements, might be de-prioritized depending on resources
## Research (Daniel, Viktor)
- Big push regarding the book
## DevOps (Rafael)
- Will focus the next 2 weeks on doing handover documentation and reviewing devops related git repos. Private repos will be moved to keybase.
## Incentives (Fabio, Vojtech)
- doc is being written for the deployment scripts for swap enabled clusters
- collection of user stories from different POVs for the postage stamps pending
## Business (Viktor)
- Negotiations are moving ahead with Consensys & others
Tracks sync 03.12.2019
=======
## Core Track (Viktor, Janos)
- Currently Elad is not present
- Handling reported problems in `master`
- Preparing GC task for etclabs
- Louis is working on file hasher
- changes to bzz address in progress
- Integration of new chunk store into local store
- Start changing protocol package to address requests by incentives team
- Talks will be had for possible candidates in the core team
- Onboarding documentation is being prepared
## Communication Track (Vojtech)
- (track lead absent)
## Adaptive Node Track (Viktor)
- no updates currently
## Specifications Track (Viktor)
- currently working on the book of swarm
## Ethereum state on Swarm Track (Viktor)
- (same as last 2 sections)
## Research (Daniel, Viktor)
- shared 3 points in research hours call ([link](https://hackmd.io/hUuvDcIBQg6zIrA-rAonIQ))
## DevOps (Rafael)
- (track lead absent)
## Incentives (Fabio, Vojtech)
- deployed swap-enabled cluster, need tests to confirm it's working correctly
- should be updated after every merge to `master`
- waiting on the ERC20 PR to be merged for automation/integration
- much of the team is involved with IOV/labitconf event
- dani said he wanted to write the SC for the postage stamps and let someone else to write the go code
- ralph and rinke should coordinate with dani regarding this issue since it seems the contract has already been written
- need to sync with vojtěch about the user stories for postage stamps
## Business (Viktor)
- continuing negotiations with strategic partners, progress is slow
- interview was had last week with potential PO
Tracks sync 25.11.2019
=======
## Core Track (Anton, Viktor, Janos)
- Solving problems that are on the cluster
- Release 0.5.3
## Communication Track (Vojtech)
- progressing on the libp2p in javascript
- demo for laBITconf
- chat similar to the one mad in Madrid by Louis and Atila
- forwarding cademlia
- light nodes
- RSA encryption
## Adaptive Node Track (Viktor)
- we included minimal adaptive node capabilities into 1.0 roadmap
- Elad and Louis wrote some specs
## Specifications Track (Viktor)
- A lot of progress on the 1.0 paper
- Open for everyone to contribute https://www.overleaf.com/2369861545hdtphqjrhyjf
## Ethereum state on Swarm Track (Viktor)
- no progress
## Research (Daniel, Viktor)
## DevOps (Rafael)
- DNS: swarmresear.ch domain has been transfered over to the ethersphere namecheap account.
- Kubernetes staging: No more spot instances are being used. You don't need to define the `nodeSelector` or `tolerations` anymore.
- Started working on creating dedicated VM group to deploy Swarm. This will avoid sharing resources with other workloads (e.g. elasticsearch, prometheus, etc..)
## Incentives (Fabio, Vojtech)
- Deployment of SWAP enabled public testnet in progress
- Now focused on private SWAP enabled network
- ERC20 enabled PR
- This generated number of vendored file changes, help requested from Janos
- Janos's feedback: We should consider removing the vendor folder completely as it is not within our control
- Browser integration - a lot of open questions, need user stories
- Number of user stories to be created about Postage Stamps and Market Price
## Business (Viktor)
- Big progress, pitch deck created, tentative release plan, roadmap
- Budget & Funding plan
- Active contact with EF and Consensys
- Meeting with new product owner recommeded by Consensys
Tracks sync 04.11.2019
=======
## Core Track (Anton, Viktor, Janos)
- highest priority is handover for infrastructure
- continuing to work on the syncing issues
- improving downloads
## Communication Track (?)
- added forwarding Kademlia to libp2p JS implementation (IOVlabs)
## Adaptive Node Track (?)
## Specifications Track (?)
## Ethereum state on Swarm Track (Viktor)
- stagnating a bit lately, main focus on core track now
- doing second iterations on PRs
## Research (Daniel, Viktor)
- discovered an attack vector
- discussed how to do retrieval incentives - most work on the core team
- only chunck delivery should be priced, not the request
- incentives for 1.0 only SWAP & postage stamps
## DevOps (Rafael)
## Incentives (Marcelo, Vojtech)
- we continue to iterate on SWAP:
- main issue is [**pending cheques**](https://github.com/ethersphere/swarm/pull/1887), which is still in progress. building on this one:
- [prevent bad cheques from being sent](https://github.com/ethersphere/swarm/pull/1925)
- [always allow debt-reducing messages](https://github.com/ethersphere/swarm/pull/1922)
- [exchange blockchain ID on handshake](https://github.com/ethersphere/swarm/pull/1913)
- these features will solve 2 open problems from [back in June](https://github.com/ethersphere/swarm/issues/1506)
- other (more minor) issues/PRs also open
- still pending:
- multiple blockchains SWIP from research (priority for IOV)
- [incentives sims bug](https://github.com/ethersphere/swarm/issues/1899) (still around)
- `retrieval` protocol changes/blacklist
- ERC20/ERC667 token integration
- postage stamps
- SWAP pricing [proposal](https://docs.google.com/document/d/1FuGe7UvWgHLBrycq80cOB54kUTP4znSOSxCDRNgB60U/edit) in progress
- RNS domain resolution PR coming soon
- also: work on smart contracts for IPFS pinning has begun
## Business
- moving ahead with Consensus - hiring product manager, they offered help with technical writers as well
- continuing discussion with other strategic partners
- interview with a candidate for PO last week
Tracks sync 28.10.2019
=======
## Core Track (Anton, Viktor, Janos)
- standing issue is still PSS push integration
- push sync will be solved (needed coordination between two tracks - Communication (Epic Labs) & Core)
- Elad working on improving the tags handling in localstore
- We need to migrate our AWS account
## Communication Track (?, update given by Janos)
- no lead right now, to be tackled soon
## Adaptive Node Track (?)
## Specifications Track (?)
## Ethereum state on Swarm Track (Viktor)
- no progress
- still finishing the header chain (finishing phase 0 & 1)
## Research (Daniel, update given by Vojtech & Viktor)
- working on multiple token payments system
## ~~Network Testing Framework~~ DevOps (Rafael)
- AWS migration planning. Swarm should have it's own account so that swarm developers can be granted access to it. Currently we're using an account that is shared across the Ethereum Foundation.
- Question: Can we rename this section to "DevOps". It should contain updates about any developer tooling/infra related topics. **Yes**
## Incentives (Marcelo, Vojtech)
- swap factory [merged](https://github.com/ethersphere/swarm/pull/1803)
- pending cheques [under review](https://github.com/ethersphere/swarm/pull/1887)
- some business logic issues [have been settled](https://hackmd.io/hUuvDcIBQg6zIrA-rAonIQ#October-24) with research
- @core: blacklist mechanism?
- nothing yet, but has to be specced before implemented
- we are waiting on Dani's SWIP on multiple blockchains, as this is a priority
- progress is also being made regarding Oracles (repo [here](https://github.com/ethersphere/swarm-oracles))
- [incentives sim bug](https://github.com/ethersphere/swarm/issues/1899) has not re-appeared _so far_
- although progressing, we are falling behind on open PRs while new issues pop up
- more of the team is back, only Fabio and Diego are absent now
Tracks sync 21.10.2019
=======
## Core Track (Anton, Viktor, Janos)
## Communication Track (Louis)
- Louis has withdrawn from the role of tracks lead and won't be joining these track sync meetings anymore. He will solve tasks assigned to him from now on.
* Meeting tmrw at roundtable will plan pss/pushsync contention and task priorities concerning pss/pushsync contention, kademlia etc
## Adaptive Node Track (Louis)
- See above. No plans on what to do further with this track for now.
## Specifications Track (Louis)
- See above. Viktor has said he will lead delivery of specs.
## Ethereum state on Swarm Track (Viktor)
## Research (Daniel)
## Network Testing Framework (Rafael)
## Incentives (Marcelo)
- incentives simulations [merged](https://github.com/ethersphere/swarm/pull/1737)
- syncing bug needs to be squashed (blocking CI on PRs); `do-not-merge` PR to check builds [here](https://github.com/ethersphere/swarm/pull/1893)
- `retrieve` protocol [now](https://github.com/ethersphere/swarm/pull/1875) blocks unsolicited chunk deliveries
- other complementary/auxiliary improvements: cleanup, tests, logs
- next milestones:
- [proper error handling](https://github.com/ethersphere/swarm/issues/1601)
- security/robustness improvements (factory for swap contract, variable range checking)
- meeting on wednesday to touch base on:
- devcon workshop takeaways
- oracles/multiple-blockchain work
- almost all of the team will be back this week so progress should accelerate a bit
Tracks sync 30.09.2019
=======
## Core Track (Anton, Viktor, Janos)
- tomorrow test of the workshop for Devcon (2 PM CEST)
- 0.5 release
- push syncing merged, outstanding:
- push/pull sync together
- session option -> runtime option
- anonymous upload https://github.com/ethersphere/swarm/pull/1828
- progress bar
- cli https://github.com/ethersphere/swarm/pull/1814
- http ui : dan, elad, rafael work on simple js
- pss indefinite reenqueue issue
- mitigated by disconnecting the bootnode from cluster - to be fixed
## Communication Track (Louis)
- Forward cache refactor created problems for push sync stability, needs investigating
- Asynchronous message handling added to improve performance may need improvements
## Adaptive Node Track (Louis)
- SWIP about how to request connectivity with peers based on capabilities and PSS capabilities both still in review
## Specifications Track (Louis)
- Oskar has reviewed the current pending spec SWIPs. Will attend to comments this week.
## Ethereum state on Swarm Track (Viktor)
- bzzeth phase 1 merged
- PR https://github.com/ethersphere/swarm/pull/1685
- User Story https://github.com/ethersphere/user-stories/issues/54
- bzzeth phase 2
- agree on simulations
- in proc sim with 2 types of mock eth clients
- k8s network test using trinity clients (Rafael)
- devcon talk preparation: https://notes.ethereum.org/To2w7YhwS0yqUMqjYiuWMw
## Research (Daniel)
- Postage stamps SWIP ready for implementation
- what needs to be implemented:
- SC that will accept on chain payments
- handle (Go module)
- forwarding part of the node should be updated
- second part of the postage stamps SWIP (about privacy) is being prepared
## Network Testing Framework (Rafael)
- no major updates, help with set ups
Tracks sync 23.09.2019
=======
## Core Track (Anton, Viktor,Janos)
- Preparation for 0.5 release, biggest blocker is push syncing
## Communication Track (Louis)
- Several PSS stuff has been merged, some of it is being rolled back
## Adaptive Node Track (Louis)
- PRs has been merged, capabilities in kademlia and PSS
- new SWIP about how to request connectivity with peers based on capabilities, both in review
## Specifications Track (Louis)
-
## Ethereum state on Swarm Track (Viktor)
- bzzeth phase 1 in progress
- PR https://github.com/ethersphere/swarm/pull/1685
- User Story https://github.com/ethersphere/user-stories/issues/54
## Incentives Track (Fabio, Vojtech)
- Priority is to generate deployments, we'll have demonstration how to do this on kubernetes later today
- We'll create SWAP enabled network
- Issue: currently when we deploy chequebook, it is not prefunded -> needed for Devcon, probably will not make it until next release
-
## Ethereum state on Swarm (Viktor)
- reviewed PR for phase 1
- preparing for our talk with Piper and Zahoor:
## Research (Daniel)
- specification for the [Postage Stamps](https://github.com/nagydani/SWIPs/blob/postage/SWIPs/swip-postage.md) is ready for implementation, probably impementation after devcon, Dani would like to participate in implementation
- Call for developers to read the specifications
## Network Testing Framework (Rafael)
- Integration of the ganache (eth blockchain for testing) helm chart with the swarm helm chart finished.
- Call with the incentives track to demo a SWAP enabled swarm cluster on kubernetes.
## Business
- Last phase of porting contracts from Dani's company to new structure. Burn rate too high, Dani and Victor cannot take salary. Business talk next Thrusday with a partner who can chip in, Consensys might help as well, talks planned with strategic partners on Devcon.
- Remark: Victor would like to have a sprint for Devcon to realize 0.5 release. All track leads: decide on what must be in the code before Devcon. - Request for features which will be in the code after Devcon and their oder of importance.
## Feedback
- Elad: There was no onboarding for the SWIPs, it is not clear what the process is. We should introduce it into the team. Elad will schedule a call with Louis, Dani and everyone who is interested on Friday.
- There will be no release tomorrow because of the performance issues, we take a time until the end of the week
Tracks sync 16.09.2019
=======
## Core Track (Anton, Viktor,Janos)
- Work on push syncing continues
- porting incentivization into retrieval
- Open question whether there must be a price for syncing
- there is a PR for this (https://github.com/ethersphere/swarm/pull/1758) - must be checked by someone from incentives
## Communication Track (Louis)
- Modular crypto first step completed
* remove whisper
* replace with modular crypto backend, temporary api
- Epic Labs propose removing crypto from node, leaving crypto at discretion of higher layer + extract all pss component in separate packages
* add a header field encrypted with the pss public key that hints at crypto scheme used
* will implement an example crypto API extension for presentation at devcon
* more details on the proposal here https://swarm-gateways.net/bzz:/c2340d4557c4dddc8472763947e81785e4eaa8e1d5ccca247f7b4906e2ff6cfa/?content_type=application/pdf
- Remove the protocol, handshake, notify and client from pss
- Task roadmap being developed for adaptive, kademlia, pss
* https://swarm-gateways.net/bzz:/c74ae046e6152ecb8267eb54085ba7035a83f0c9a4aa905df7358efeb53de3e9/
* kademlia prioritization will be discussed at roundtable 17.9
- SWIP for initial kademlia load balancing proposed
* https://github.com/ethersphere/SWIPs/pull/28
* Epic Labs Álvaro will implement
## Adaptive Node Track (Louis)
- Kademlia capabilities integration PR submitted for review, approved by @zelig, reviewed by Álvaro
* https://github.com/ethersphere/swarm/pull/1713
- Next step is enable live change of capabilities, preparation for demonstration at devcon
## Specifications Track (Louis)
- New SWIP first drafts added:
* hive (connectivity engine) - https://github.com/ethersphere/SWIPs/pull/25
* discovery protocol - https://github.com/ethersphere/SWIPs/pull/26
* content hashing - https://github.com/ethersphere/SWIPs/pull/27
- SWIPs updated with dependencies for the above:
* kademlia - https://github.com/ethersphere/SWIPs/pull/24
* address fundamentals - https://github.com/ethersphere/SWIPs/pull/17
## Incentives Track (Fabio, Vojtech)
- Creating a series of PRs (improving SWAP code to be more robust)
- This week want to integrate retrieval protocol and deployment to test network
## Network Testing Framework (Rafael)
- Swarm-private helm chart: Possibility to provide configuration to specific swarm containers: [ethersphere/helm-charts#94](https://github.com/ethersphere/helm-charts/pull/94)
- Started integration of the ganache (eth blockchain for testing) helm chart with the swarm helm chart, so that we can start running deployments with incentives enabled.
## Ethereum state on Swarm (Viktor)
- Merged fix for phase0 PR (bug which didn't allow disconnected nodes to reconnect)
- Phase1 will be done by Thursday (probably)
## Research (Daniel)
- no updates
## Business (Victor)
- Last phase of porting contracts from Dani's company to new structure. Burn rate too high, Dani and Victor cannot take salary. Business talk next Thrusday with a partner who can chip in, Consensys might help as well, talks planned with strategic partners on Devcon.
- Remark: Victor would like to have a sprint for Devcon to realize 0.5 release. All track leads: decide on what must be in the code before Devcon. - Request for features which will be in the code after Devcon and their oder of importance.
## Feedback
- Confirmation on not paying for synching (question by Marcello)
- A: Postage stamp for spam protection, also paying via SWAP.
Tracks sync 09.09.2019
=======
Please all track leaders do a bit of issue grooming and assign good first issue labels to appropriate tasks. There is interest from potential contributors.
## Core Track (Anton, Viktor, update given by Janos)
- focus this week will be merging the new streamer
- also push syncing PR (to be merged this week or next one)
- other non-crucial experiments going on
## Communication Track (Louis)
- PR for removing whisper from PSS in review https://github.com/ethersphere/swarm/pull/1731
- estimated week or so before finished
- Cleanup PSS code ongoing, first step PR https://github.com/ethersphere/swarm/pull/1734
- Will be done stepwise, first component (cache) working on, using a dated testing framework which is not used by other Swarm packages (might discuss during roundtable)
- First draft spec for kademlia forwarding (and prerequisites) PR https://github.com/ethersphere/SWIPs/pull/24
- to be reviewed
- Submitted proposal 50% of devcon breakout slot about modular crypto in pss
## Adaptive Node Track (Louis)
- Still working on inclusion of capabilities in kademlia/discovery, experiencing trouble with RLP serializations in integration tests https://github.com/ethersphere/swarm/pull/1713
- Submitted proposal 50% of devcon breakout slot about adaptive modes of operations (API plus example involving PSS)
## Incentives Track (Fabio, Vojtech)
- working on tasks from `incentives` to `master` PR
- looking into in-process simulations
- difficulties simulating w/swap due to back-end URL param, interaction with blockchain, etc.
- current simulation alternative is not suitable with integration testing
- multiple PRs open
- discuss review process during the roundtable
## Network Testing Framework (Rafael)
- skipped, Rafael not present
## Ethereum state on Swarm (Viktor)
- working on bug not caugh by unit tests
- tests for phase 1 went well
## Research (Daniel)
- Postage stamp SWIP https://github.com/ethersphere/SWIPs/pull/8
- objective: produce and specification that can be implemented now (might share tomorrow)
## Business (Tim)
- need stable version of swarm to move ahead
## Feedback
Tracks sync 02.09.2019
=======
Please all track leaders do a bit of issue grooming and assign good first issue labels to appropriate tasks. There is interest from potential contributors.
Please don't forget input your latest update to our [August newsletter hackmd](https://hackmd.io/0bNLLTgpQFKLLpvnlsiuPQ) till 31st August.
## Core Track (Anton, Viktor, update given by Janos)
- Anton is back, plan to tackle new syncing
- testing environment for incentives
- push sync - waiting for Anton to review
- smoke tests on master are failing, work on the sync track though -> request to help disecting master
## Communication Track (Louis)
- modularize crypto in pss -> merged https://github.com/ethersphere/swarm/pull/1698
- improved queue handling in pss -> merged https://github.com/ethersphere/swarm/pull/1695
- investigating k8s network testing for pss (will sync with Raf when hes back)
- will start working on general pss crypto API, make sure it matches with a number of reference crypto schemes
- code cleanup in progress, important for quality of work going forward
## Adaptive Node Track (Louis)
- API PR merged, PR for capabilities in kademlia records up, in progress: https://github.com/ethersphere/swarm/pull/1713
- First SWIP merged - datatypes for capabilities https://github.com/ethersphere/SWIPs/pull/18
## Incentive Track (Fabio, Vojtech)
- Incentive PR merged to master!
- looking into deploying to testnet
- 3 SWIPs proposed:
- [Message to honey](https://github.com/ethersphere/SWIPs/pull/21)
- [Honey to money](https://github.com/ethersphere/SWIPs/pull/20)
- [Multiple payment processing support](https://github.com/ethersphere/SWIPs/pull/22)
## Network Testing Framework (Rafael)
- skipped, Rafael not present
## Ethereum state on Swarm (Viktor)
- Phase 1 done
## Research (Daniel)
- focus on SWIP 1 day this week, working on postage stamps
## Business (Tim)
- session with John on setting up Swiss foundation
- strategic partners sync planned
- Ethereum foundation milestones presented and generally accepted
## Feedback
Tracks sync 26.08.2019
=======
Please all track leaders do a bit of issue grooming and assign good first issue labels to appropriate tasks. There is interest from potential contributors.
Please don't forget input your latest update to our [August newsletter hackmd](https://hackmd.io/0bNLLTgpQFKLLpvnlsiuPQ) till 31st August.
## Core Track (Anton, Viktor, update given by Janos)
- consolidating for release 0.5 which includes pinning and hopefully new stream (still in PR)
- PR updating the goethereum packages to new version, there are some problems that need to be solved, this is mostly manual process checking what are the changes but luckilly there are also some failing tests as well.
- push sync PR, might also be part of 0.5 release
## Communication Track (Louis)
* pss port to swarm simulations approved by lash, need one more
* pss queue handling improvement will compare two implementations for speed
* added new issue for p2p/rlp independent serialization in pss (better for spec)
* Bug-Fixed on the Hashing Algorithm which led to less matched in the cache
## Adaptive Node Track (Louis)
* capabilities api PR still pending approve and merge
* reformatted spec SWIPs and scripted a bit for the latex->md conversion, and re-submitted now to main repo.
## Incentive Track (Fabio, Vojtech)
- Number of SWIPs ready to propose this week
- [`message to honey`](https://github.com/Eknir/SWIPs/blob/msgToHoney_review/SWIPs/swip-message_to_honey.md) final internal reviews will be proposed this week.
- [`honey to money`](https://github.com/Eknir/SWIPs/blob/fabioReviewUpdates/SWIPs/swip-honey_to_money.md) describes simple interface, will also likely be proposed this week.
- [`multiple payment providers`](https://github.com/Eknir/SWIPs/pull/12) will be proposed by IOV this week.
- [`incentives` PR](https://github.com/ethersphere/swarm/pull/1554) to master approved by Viktor and Elad, ready to merge!!!
- Rinke started to work on the `message to honey` oracle implementation.
## Network Testing Framework (Rafael)
- [Grafana](https://github.com/ethersphere/helm-charts/pull/91) and [InfluxDB](https://github.com/ethersphere/helm-charts/pull/93) updated on our helm charts
- Integrate blockchain (using Ganache) and Swarm (with incentives) on our helm charts (In progress)
- Possibility to request [faster disks (IO1)](https://github.com/ethereum/swarm-cluster/pull/185) with more IOPS
## Ethereum state on Swarm (Viktor)
- P2P propagate context PR merged
- Phase 0 [PR ready for review](https://github.com/ethersphere/swarm/pull/1685)
- Phase 1 PR in preparation
## Research (Daniel)
- Reviewed a few SWIPs
- Setup office hours on every Thursday to discuss any research
## Business (Tim)
- Meeting between Swarm, EF & IOV
- Meeting between Swarm, EF & Status
- Meeting Tim + Luis + EF Layer about legal stuff for GMBH
## Feedback
- Status re-iterated they want to be part of incentivisation at least on the research side
- Incentivization of adoptive nodes should also be considered soon
- Gitcoin campaign to be created for small javascript task in the Network Testing Framework
Tracks sync 19.08.2019
=======
## Core Track (Anton, Viktor, update given by Janos)
* New Stream fixes and performance improvements
* Continuing work on tags and pinning and documentation for the upcomming 0.5 release
* Benchmarking for bossible localstore improvements
* Adding multi chunk operations for localstore
## Communication Track (Louis)
* EPIC labs ready to submit PR on https://github.com/ethersphere/swarm/issues/1654 also well underway with https://github.com/ethersphere/swarm/issues/1652 will follow up with consolidating common test code in pss package
* Experimental code refactor to show how Kademlia can be provided as a service instead of embedding from outside constructors across modules https://github.com/ethersphere/swarm/pull/1676
- also shows how hierarchical service tree in Swarm can be avoided)
## Adaptive Node Track (Louis)
* Felfele have refactored their POC build to use `go mobile` and built successfully. Need to define API for starting, stopping node etc.
- Will keep API wrappers in separate repo for now.
- Status will support them
* Adaptive capabilities intro PR merged https://github.com/ethersphere/swarm/pull/1619 followup PR introducing API currently in review https://github.com/ethersphere/swarm/pull/1675 then https://github.com/nolash/swarm/tree/adaptive-kademlia will follow
* Hacked the bzz handshake for `nim-eth`, successfully completes against `golang` node and entry found in kademlia https://github.com/oskarth/nim-eth/pull/2
* Had IRL meet with Status' Oskar and Dean, have consensus on data representation basics in spec authoring
## Incentive Track (Fabio, Vojtech)
* Viktor has made another review to the `incentives` PR, changes have been applied but there are still points to be resolved
* According to Fabio, we are expecting another review from Elad (this will be followed up on)
* 2 SWIPs will be pushed this week - msgHoney oracle and probably the multiple payments but as IOV
* 2 more will be pushed next week
## Network Testing Framework (Rafael)
## Ethereum state on Swarm (Viktor)
## Research (Viktor)
## Business (Viktor)
## Feedback
Tracks sync 12.08.2019
=======
Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.
Epics / User Stories
General Updates of the Track
Blockers and Resource planning
## Core Track (Anton, Viktor, update given by Janos)
- New stream memory leak fix
- HTTP API support for pinning contents - bzz-pin scheme handlers https://github.com/ethersphere/swarm/pull/1658
- Progress bar HTTP API - bzz-tag scheme handlers https://github.com/ethersphere/swarm/pull/1649
- Go Modules, vendoring https://github.com/ethersphere/swarm/pull/1532 and linting https://github.com/ethersphere/swarm/pull/1661
## Communication Track (Louis, Vojtech)
- Epic Labs started working on task pss send queue optimization https://github.com/ethersphere/swarm/issues/1654
* work will be coordinated here https://beehive.ethswarm.org/swarm/channels/pss
- Waiting for feedback from IOVLabs on existing pss spec/documentation
- Updated pss prox test to use distance as success metric - branch here: https://github.com/nolash/swarm/tree/pss-prox-distance-test which depends on https://github.com/ethersphere/swarm/pull/1621
* The test can and should now be simplified (all of them actually need a [refactor](https://github.com/ethersphere/swarm/issues/1652)), but should be done after we implement [kademlia as-a-service](https://github.com/ethersphere/swarm/issues/1656)
## Adaptive Node Track (Louis)
- Progress divided in three sequentially dependent branches. They are currently working and tests passing. However, the first PR was amended after comments to use bool arrays instead of bitflags for storing capabilities, but this is inefficient when comparing caps to each other, so this change should be reverted. Conceptually it need not change.
* [adaptive capabilities protocol](https://github.com/ethersphere/swarm/pull/1619)
* [adaptive capabilities API](https://github.com/nolash/swarm/tree/adaptive-capabilities-api-short)
* [adaptive capabilities kademlia integration](https://github.com/nolash/swarm/tree/adaptive-kademlia)
- Adaptive SWIP must be rewritten as platform independent spec.
* Handshake and pss spec will depend on this SWIP.
- Since noone in the team responded to my request for adding status as reviewers in the SWIP repo, the preliminary discourse is now happening on my own fork https://github.com/nolash/SWIPs/pulls - this is pretty silly, and it's annoying that such a simple little thing needs to be chased so much.
## Incentive Track (Fabio, Vojtech)
- We still have the [big PR open](https://github.com/ethersphere/swarm/pull/1554), Elad did another review today, there is only a few comments, hopefully will be resolved today
- Reduced the 5 to 3 [SWIPs](https://github.com/Eknir/SWIPs), in internal review now
## Network Testing Framework (Rafael)
- No change. Nothing to update.
- SWAP testing on kubernetes: Rafael to discuss requirements with Fabio.
## Ethereum state on Swarm (Viktor)
- Done with Phase 1 (integrations tests to be done)
- Zahoor will hopefully help this week
- This week continue to work on Phase 2
- Track sync call with Piper this Thursday
- Funding secured through Giveth platform
## Research (Viktor)
## Business (Viktor)
- The big kick off call for the legal entities
- Short term Swarm Foundation, possibly also service company
- Long term possibly consortium
- Maybe DAO as well
## Feedback
- Reaction to Status team not being added to the Swarm repo
- Suggestion from Viktor: We should dedicate someone who is responsible for this admin stuff and devops
- Question about Adaptive notes: There is a need in the Incentive team to negotiate things like prefered payment solutions at handshake - should this be reflected in the adaptive nodes SWIP?
- There has not been updates from the Network Testing Framework, what is the status?
* (lash) **Q:** would like to know eg can I with CURRENT state of framework create a remote node test with pss nodes sending and receiving messages?
* (rafael) **A:** Yes, any exposed RPC calls (also the ones for PSS) can be executed. See this [example](https://github.com/ethersphere/swarm/blob/master/simulation/examples/cluster/cluster_test.go).
- Milestone for Ethereum foundation: How important it is? With Rafael & Anton on holidays leading to the delivery,
- (vik) let's push for the delivery by the end of August
- (lash) when we define milestones there should be some degree of "celebration" on reaching them. otherwise it feels more like a "hurry up and wait" trap, which is anti-climactic and can easily be detrimental to morale
- New developer for incentives
- SWIP workflow - can we work on the branch of SWIP repo rather than creating fork and working there? Because if not we need to replicate the access rights to the repo.
- (viktor) Encourages working directly in the ethersphere repo on a separate branch
# Tracks sync 05.08.2019
=======
Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.
Epics / User Stories
General Updates of the Track
Blockers and Resource planning
## Core Track (Anton, Viktor)
## Communication Track (Louis, Vojtech)
- Initial call with EPIC labs, will already start ramping up august, full work from september. We use own mattermost ch to coordinate
* did PSS walkthrough with drafts of open issues as in https://cryptpad.fr/pad/#/2/pad/edit/uZ0ekYVFzW8XLNYzAkgvJHz8/ - Louis will add them to backlog issues
- Posted PR for suggestion of data representation in protocol specs (blocker for completing pss spec) https://github.com/nolash/SWIPs/blob/datatypes/SWIPs/swip-data-types-descriptions.md
* pss spec will be posted as SWIP in md once the above is done
## Adaptive Node Track (Louis)
- PR for caps protocol still under review, one reneg (vik) one approval (elad) so far.
- Updated original adaptive node caps proposal in new SWIP format
- It is now again very unclear who is responsible for what. For example; the Status project main aim is spec of swarm node, I'm the contact for Status, but responsibility or the specs are placed in research track, making me responsible for something I have little influence over. **I don't want that.** This needs to be cleared up.
- Next week Dean and Oskar is coming to Berlin next week and we will hack together
## Incentive Track (Fabio, Vojtech)
- Tension: most decisions are made in the research team but Fabio is responsible for implementation. Most of the questions outsourced to research, sometimes slow but wokrs so far.
- Still working on the big `incetives` to `master` PR, currently requested changes from Viktor, but Elad is in India and his internet connection is cut. This means the PR might be blocked until he gets online.
- Marcelo handling Viktor's comments today, number of open PRs by Rinke to be reviewed
- Fabio working on simulations on the side, we can use in process simulation which is nice
- [SWIP call about SWAPs](https://hackmd.io/iEsK4LblRN-4R4hGGRZeWQ?view). Next steps: unify some of them, make PRs, break down to issues.
## Network Testing Framework (Rafael)
## Ethereum state on Swarm (Viktor)
- Finalise Giveth campaign - the way we implement anonymous donation transparently
- iteration on EPIC, status is
- phase 0 tested
- phase 1 tested in code, waiting to be tested with trinity
- phase 2 dev halfway - see https://github.com/ethersphere/swarm/pull/1571
- blocker issue resolve by PRs https://github.com/ethersphere/swarm/pull/1647, https://github.com/ethersphere/swarm/pull/1648
- Zahoor is gonna get onboarded week of 12th
- next meeting with Piper Thursday 15th 5pm
## Research (Viktor)
## Business (Viktor)
- launch legal/funding/intitutional strategy working group
## Feedback
- It is unclear if the SWIP for adaptive nodes needs to be reapproved
Tracks sync 29.07.2019
=======
Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.
Epics / User Stories
General Updates of the Track
Blockers and Resource planning
Updates structure
Communication Track (Louis, Vojtech)
Core Track (Elad, Viktor)
Incentive Track (Fabio)
Network Testing Framework (Rafael)
Research (Daniel)
Other
Network-Testing
Release Planning
Documentation
## Core Track (Anton, Viktor)
- Progress on the Push-sync. PSS fixes (Push-sync is dependent on PSS) - some of them merged.
- https://github.com/ethersphere/swarm/pull/1580
- https://github.com/ethersphere/swarm/pull/1392 (in progress ; was on hold until today)
- Pull-sync - started running smoketests, so far good results
- https://github.com/ethersphere/swarm/pull/1538 (in progress)
- Simulation framework - bit more automated tests especially for Push-sync
- Pinning content
- https://github.com/ethersphere/swarm/pull/1509 (in review)
- No update on Kademlia improvements
-
- Download improvements - Viktor to code a asynchronous lookahead buffer to improve the download functionality https://github.com/ethersphere/swarm/issues/1524
## Communication Track (Louis, Vojtech)
- adaptive node capabilities code rewriting https://github.com/ethersphere/swarm/pull/1619
- milestones with status changes; deliverables are now full spex of swarm node by end of year, draft outline of milestones:
> > This includes SWIPS for:
> > - SWIP: General P2P Specc (P2P Communication assumptions)
> > - SWIP: The HIVE Protocol (Wire-Protocol Specification + Bootstraping Strategy)
> > - SWIP: Kadelmia + Routing
> > - SWIP: PSS Wire Spec
> > - SWIP: PSS API Specification
> > **Milestone 2:** Adaptive nodes (client and server) specs
> >> - Including light node connection strategy
> >> **Milestone 3:** BZZ spec (possibly divided into get and post phases)
> > - SWIP: Retrieval Wire-specification / Fetching
> > - SWIP: Stream Protocol
> > - SWIP: Syncing Protocol
> > - SWIP: HTTP Interface
> >> **Milestone 4:** BZZ incentives spec
> > - SWIP: SWAP (P2P Accounting)
- considering rewiring pss, making crypto/handshakes pluggable, move whisper out to "plug" or eliminate
- pss spec reviewed by vik, implemented in PR, waiting for confirmation - also awaiting feedback from iovlabs and status on the textx
- Comm track will be split up in Comm track and Adaptive nodes track from now on (louis heads both)
## Incentive Track (Fabio, Vojtech)
- scheduled to promote the open PR from `incentives` to `master` on Friday, delayed due to bugs
- last PR to `incentives` branch, good to go after
- blockers:
- how to run simulation for tests (blockchain simulation)
- number of [SWIPs](https://docs.google.com/document/d/1U7lMvB7ySYaiynrXd0me6NUwWeG1r2T57pi9E46O5kM/edit?usp=sharing) to be shared this week
## Network Testing Framework (Rafael)
- Initial PR merged [#1555](https://github.com/ethersphere/swarm/pull/1555)
- Retry mechanism for Exec Adapter when there is a UDP port collision [#1616](https://github.com/ethersphere/swarm/pull/1616). Thanks @nonsense
- We should get rid of go-ethereum p2p discovery and the UDP server altogether, but this is a bigger effort.
- Next steps: Refactor "upload and sync" smoke test to also work with the framework.
## Research (Viktor)
- trying to get to Dani will write the two promised
## Ethereum state on Swarm (Viktor)
- Moving ahead, Viktor is implementing the Phase 1 & 2
- This track got some charitable donors, so we have funding to put resources on this track
- Most likely will work with Epic Labs to add resources to the team soon
## Business (Viktor)
- work to move ahead with Swarm foundation
- consolidating collaboration with Status.im, mainly focuses on writing the specs and completing them by the end of December
## Feedback
- Louis: the Communications track is refering to both communications and adaptive nodes which is confusing, maybe those should be split into tracks both in the hands of Luis. Encouragement to split these two
- Marcelo: how to handle the comments from reviewers on the `incentives` PR? Consensus: make the commit changes directly to the `incentives` branch.
- How to handle big PRs?
- Maybe we can split them into chain of PRs with rebasing in the middle. Danger with splitting is that sometimes the code in PR is not even used.
- Maybe setting up maximal size per PR?
- Conclusion => lets aim for digestable size of PRs
- Suggestion for the `incentives` branch. Split into 3 PRs:
- PR removing legacy code
- PR adding autogenerated code from smart contracts
- PR with all the new code
Tracks sync 22.07.2019
=======
Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.
Epics / User Stories
General Updates of the Track
Blockers and Resource planning
Updates structure
Communication Track (Louis, Vojtech)
Core Track (Elad, Viktor)
Incentive Track (Fabio)
Network Testing Framework (Rafael)
Research (Daniel)
Other
Network-Testing
Release Planning
Documentation
## Core Track (Anton, Viktor)
* Pull Sync should be finalised this week / early next week
* PSS is open Pull sync - louis will address open questions
* Upload of 1 GB and Download was possible with 40 Swarm-Nodes (only with push sync, no pull sync)
* Small improvements have been done on API endpoints
* Small improvments on testing
* Structured output of Kademlia table per node
* Blocker: PSS (due to Push Sync being dependent on it)
* No update on Kademlia improvements
* No update on Download improvements
## Communication Track (Vojtech)
* Louis just came back from vacation
* Brief update with Status -
* Short discussion Adaptive Node Track / Comm-Track
*
* Vojtech - IOV is commited to use to PSS and would like to support the adaptive node track with Status
## Incentive Track (Fabio, Vojtech)
* PR to master should be ready by EOW (ready or merged)
* Open questions about details
* Idea to create a SWIP for the SWAP part
* OPEN QUESTION: L2 Smart-Contracts for Pinned conntent (with Zahoor) maybe Rinke and Rafael could start looking into that after completing the SWAP smart contracts? (Tim)
## Network Testing Framework (Rafael)
* Initial snapshot feature inside [PR#1555](https://github.com/ethersphere/swarm/pull/1555)
* Missing Tasks for the Framework
* Louis Q: RPC Call which need to be included - whats the status on this?
* "These" RPC Calls for Debugging or other purposes - are there any changes? Or is this future work? (Louis)
* Anton answer: There is structured output on kadelmia. There are other ideas how to make simpler tests for the future. [PR#1586](https://github.com/ethersphere/swarm/pull/1586)
* Rafael answer: That RPC call is also useful to test the snapshot feature
* Fabio question: Is this a proxy? What do I know to review the RPCs?
* Rafael: RPC via RPC call fuction. This is worked on. Some is already there for the BZZ client.
* Fabio: How to check balance?
## Research (Viktor)
* Session with Dani, Aron and Viktor
* Worked on the open questions regarding the SWAP
* https://swarmresear.ch/t/questions-on-incentive-development/37
* Fabio: Useful input to fullfill the current needs of the incentive track.
* Viktor: How can we combine posted stamps + swap profitability - writeup TBD
* Viktor: Fetcher timeout vs 404 if a chunk is not found - writeup TBD
* Current Fetcher is not incentive compatible
## Business (Tim)
* Ethereum Foundation supports the creation of a Swarm Foundation (Timeline aiming for October / November to create the Swarm Foundation)
## Feedback
* Upfront summary written by track-lead would be useful
* Review of the notes should also be done by the track-lead if not written by themselves
Tracks sync 15.07.2019 (Written Feedback)
=======
Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.
Epics / User Stories
General Updates of the Track
Blockers and Resource planning
Updates structure
Communication Track (Louis, Vojtech)
Core Track (Elad, Viktor)
Incentive Track (Fabio)
Network Testing Framework (Rafael)
Research (Daniel)
Other
Network-Testing
Release Planning
Documentation
## Network testing (Rafael)
- Initial PoC with Exec/Docker/Kubernetes adapters is working: [Draft PR](https://github.com/ethersphere/swarm/pull/1555)
- Written a discovery test using the new framework. Works on all 3 adapters.
- I will create a list of remaining tasks for the implementation of missing features and attach it to the [epic#33](https://github.com/ethersphere/user-stories/issues/33)
## Incentive track (extraordinarilly by Vojtech)
### Hack week achievements:
- Implemented simple SWAP happy path only (=not handling edgecases, blockchain errors etc).
![Happy path SWAP](https://i.imgur.com/c7pxy4J.png)
- In terms of the [metrics document](https://docs.google.com/document/d/1yAjCDbjXKJ3uZYOAQT0lAtq2rq1NvjGx12twhm5gRj4/edit) (~~strikethrough~~ items were planned but not achieved):
- Admins can query node’s balances book through API
- Nodes deploy SWAP smart contract and deposit as they go online ~~(if not already) and this is stored in persistent storage~~
- ~~(ideally) Nodes replenish the SC with hardcoded value…~~
- Nodes issue cheques to each other including the SWAP SC address
- Cheques are cashed out immediately as they arrive, these are 2 calls
- Submit cheque
- Cash out cheque (after delay allowing challenge)
- (ideally) ~~automated~~ (local) testing which deploys 2+ nodes and ~~simulates~~ manual traffic
- ~~Integration with the new syncer~~
- You can try it on incentive branch (with custom network) by running: `swarm -swap -swap-api=https://rinkeby.infura.io` but make sure you have some rinkeby eth
- [List of assumptions and decisions](https://hackmd.io/5457QI8SRf-Byhp6xY-jEg?view) made
- Increase a familiarity with a go code and reponsibles/experts for individual parts
- Established communication with the Swarm team
- 3 new epics/user-stories
- End-do-end test contract test with simulated backend
### Lessons:
- It is difficult to coordinate with track lead who is not physically present and it creates delays and tensions. For the next time we should make a separate branch for the hack week that is then merged.
### TODO:
- Number of [new issues](https://github.com/ethersphere/swarm/issues?q=is%3Aissue+is%3Aopen+label%3Aincentives) to tackle
- Polish the `incentives` branch and prepare merge to `master` (this includes a bigger discussion and implementing things like [#1550](https://github.com/ethersphere/swarm/issues/1550))
### Blockers:
- Still unclear how will research decisions be finalised
## Eth on swarm
- successful handshake between trinity and swarm
phase 0 of the [epic](https://github.com/ethersphere/user-stories/issues/9) is dev ready
- Elad and Viktor submit [first bzzeth PR](https://github.com/ethersphere/swarm/pull/1571)
- iteration on epic
- to write up incentive aligned strategy to handle newblock header hashes
- start work on phase 1
### Blockers
protocols.go message wrapping causes incompatibility
https://github.com/ethersphere/swarm/issues/1575
## Core track
1. Push sync / PSS
- added tracing to Push sync
- added PSS timers and dashboard
- fixed blocking calls between Push sync and PSS
- attempt to profile PSS and to increase performance - https://github.com/ethersphere/swarm/issues/1574
2. Pull sync
- improved existing tests
- added live and combined live and history test cases
- added benchmarks (which turn out to be not so reliable)
- defined more test vectors
- integrated new retrieval and streamer onto swarm.go and started running integration tests
3. Efficient download
- no progress
4. Kademlia improvements
- no-hive-discovery flag, as preparation for integration tests - https://github.com/ethersphere/swarm/pull/1576
Tracks sync 01.07.2019
======
Note: Session will hopefully be recorded.
This is a holiday for some of the team. Participation is optional. Session will be recorded.
# Agenda:
General Updates of the Track
* Epics / User Stories
* Blockers and Resource planning
General discussion
# Updates structure
Communication Track (Louis, Vojtech)
Core Track (Elad, Viktor)
Eth on Swarm (Vik)
Incentive Track (Fabio)
Network Testing Framework (Rafael)
Research (Aron)
# Other
Network-Testing
Release Planning
Documentation
## Communication Track (Louis, Vojtech)
[Swarm Improvement Proposal (SWIP)](https://github.com/ethersphere/swarm/issues/1514)
Currently no real blockers, did not hear from Status yet for both the proposal nor the specs.
## Core Track (Elad, Viktor)
Vik submit pr to push sync branch - problems sim framework
1. anton and vik disagree on implementation
2. fix bug which makes test pass
hopefully merge after next review
http download is reading in sync batch, but could do parallell req instead, creates unnecessary latency.
Elad making good progress on pull sync, anton helping reviewing
Janos is back, being assimilated
Hopefully with better traceability, if chunk is not synced, better understand where failed
Board is up to date
## Eth on swarm
telegram group set up, bridged to mattermost
epic finalized for header chain, 3 phases set up, will be made to user stories
upcoming task: come up with user stories for the epics/phases
https://github.com/ethersphere/user-stories/issues/9
## Incentive Track (Fabio)
No much happened on board.
Rinke 100% and Ralph 40% are officially working
First done task: drop submitcheque...
Flow diagram how messages will be handled
Discussion and new questions:
https://github.com/ethersphere/swarm/issues/1506
more integrated process working with research, aron not on github how to poke, dani good session 1-2 weeks. need more than one session per week. Better to have official protocol - get attention and address research stuff
fabio worked on cheques exchange protocol - where get private key, there is legacy code, went through with vik to decide what to prune, => rabbit hole, addresses a lot of different interrelated things so may be a longer task.
3 SWIPs in work:
- Payment mechanism - proposal how multiple payment solutions could work together (own payment channel implementation, lumino/raiden...)
- how to handle advances ui that includes payment + upload (right now we have simple gateway to just download files)
- JS libraries with support for incentive
## Network Testing Framework (Rafael)
- Tried using exec/docker adapters on existing tests and failed
- Comming up with an alternative approach
- Proposal to be done on tomorrow's Roundtable (02.07)
- rafael will sync with janos
## Research (Aron)
- Had several discussions (Aron & Dani, or Aron, Dani & Viktor). Daniel is working on an exhaustive list of anticipated node interactions and their incentive compatibility. Key questions involved syncing and lottery and their relation to xor distance in most proximate nbhd.
Ideas discussed are payment-via-lottery to avoid the 'burn' in postage. Incentive compatibility of pay-for-sync. Future transition of postage to storage insurance.
Dani will post his writeup to swarmresear.ch later today.
## Entanglement codes research collaboration
Had call Vik Aron
Submit talk to Devcon
Found some issues not covered
Will be writing EPIC (when?)
In order for it to be proper track, needs to tackle chunker, probably not be very soon
## Documentation
Is a separate track, but there is no lead yet.
### Discussion
- Sync with research. Was meeting set up thursday two weeks ago. Dont know why. had last thursday also, not all present.
* research channel in mattermost for quick question - to draw attention to a need / topic
* mattermost is emphemeral, gets lost if time passes. not for permanent decisions.
* treatment, conclusion, decision -> swarmresear.ch
- Need a source-of-truth document! <- this is the most important, get this started.
- calls are a good medium to involve as many research ppl as possible, we need a way to document decisions we make
- more reliable way for back-and-forth
* ex threshold handling, when should drop peers? also affects other protocols, should be agreement on when to drop peers and what are the repercussions.
- when is should be elevated to the research group, what can be replied directly from single member. usually just post to research channel, if noone says something it.
- we seem to converge on:
* mattermost for get attention
* swarmresearch for discussion if question that needs treatment
* stored in a "formal" document (where? need to decide) when finalize