Please all track leaders do a bit of issue grooming and assign good first issue labels to appropriate tasks. There is interest from potential contributors.

Tracks sync 09.03.2020

Core Track (Janoš)

  • testing infrastructure
  • preparation for mallorca (submit new entries for agenda)
  • BEE Project

Communication Track (Vojtěch)

(absent)

Pinning (Viktor)

  • zahoor working on PR (link?)

Book of Swarm track (Viktor)

  • working on diagrams
  • Rewrite feed chapter
  • Worked with Rinke on revising lottery part
  • Going to create entry for Mallorca about APIs

Incentives (Rinke, Marcelo)

Business (Gregor)

  • swarm was present @ETHCC with 2 talks
  • Developer update newsletter
  • Proposing to have somebody responsible per track for updates

Devops (Svetomir)

  • Mallorca
  • Testing infrastructure

Tracks sync 02.03.2020

Incentives (Rinke, Marcelo)

Tracks sync 24.02.2020

Core Track (Janoš)

  • new chunk store - fixing an issue with ??? regarding the garbage collector
  • continuing hive integration

Communication Track (Vojtěch)

Pinning (Viktor)

  • starting with single owner chunk implementation

Book of Swarm track (Viktor)

  • a lot of progress diagrams (swarm hash, postage stamps), kademlia explanation
  • plan is to consolidate and start writing the specs soon
  • EDCON has been canceled, we should find alternative event to announce the book

Incentives (Rinke, Marcelo)

  • beginning to implement agile workflow
  • part of the team still reading the book of swarm
  • PRs that Ralph submited - racing conditions

Business (Gregor)

  • first draft of the status of association - needed for creating Swiss association
  • Community management
    • a lot of updates
    • events, colaboration with partners, campaigns etc
    • collaboration with AIBC

Devops (Svetomir)

  • deployed everything in the new production cluster, waiting for sync
  • once synced the old cluster will be shyt down
  • Svetomir will present some updates tomorrow at the roundtable

Tracks sync 17.02.2020

Core Track (Janoš)

  • finished the initial backs for protocols
  • retrieval protocol as PR

Communication Track (Vojtěch)

  • juraj started to work on a sync protocol (due to no msg persistence)

Pinning

  • started to experiment with single owner chunks see epic #58

Book of Swarm track (Viktor)

  • merged protocols part, added handshake and hive protocol
  • call with 3 ppl from IOVlabs on Friday
  • added color coding for the state of writeups
  • need a lot of help with the diagrams

Incentives (Marcelo, Vojtěch)

  • meeting about SWAP architecture within bee
  • finished talking about the Survey results
  • Ralph finished PR about transaction queue
  • unifying variable type still in progress
  • meeting about incentivised testnet

Business (Viktor)

  • positive feedback from ETClabs about the token sale
  • good meeting with Midhub they are supporting us
  • Gregor and Fatim has finalised the papers for association

Devops (Svetomir)

External communications

  • blog about pinning

Tracks sync 10.02.2020

Core Track (Janoš)

  • work on swarm 0.6.0 version
    • 0.5.6 released/deployed
  • hive being worked on
  • interfaces for kademlia/usage of pot/move code from swarm to bee
  • more/improved tests
  • tracing is trying to be added

Communication Track (Vojtěch)

(absent)

Book of Swarm track (Viktor)

  • kademlia table section being worked on by Dani
  • completing the vision part

Research (Daniel, Viktor)

  • topic about the book might be brought up during next office hours

Incentives (Marcelo, Vojtěch)

  • results for incentives track survey are being shared and discussed
  • book of swarm is continued to be reviewed
  • merged support to state store PR
  • unify variables pt 3 and refactor backend PRs still in progress

Business (Viktor)

  • interview with potential PO

Devops (Svetomir)

  • helping elad out with deployment
  • work on AWS accounts
  • continue with deployment of k8s clusters to terraform
  • next week cluster can be migrated
  • need more input about the chart

Tracks sync 03.02.2020

Core Track (Janos)

  • working on protocol writeup, this can hopefully later on be included in the book
  • key handeling for bee repo

Communication Track (Vojtech)

  • updating libp2p to async/awaid from callbacks

Book of Swarm track (Viktor)

  • going ahead with Rinke
  • idea is to open the book to everyone
  • communications still needs to be written

Research (Daniel, Viktor)

  • no update, probably will have a token writeup today by Dani

Incentives (Marcelo, Vojtech)

  • continuing to work on the testnet metrics
  • this tuesday we will have presentation how we envision the sprint organisation

Business (Viktor)

  • no update

Tracks sync 27.01.2020

Core Track (Janos)

  • Continuing with libp2p experimental implementation github.com/janos/bee, a bit behind with testing, actively working on abstriction, Petar will start hive protocol, Elad retrieval protocol
  • problem with current Swarm - requesting ENS queries for old hashes
  • next Swarm release supposed to happen today, somewhen this week

Communication Track (Vojtech)

  • Waiting for libp2p rewrite callbacks to promisses
  • Added RSA key support

Book of Swarm track (Viktor)

  • Timeline is to finish reviews at the end of February, public end of March
  • next steps is to cut down verbosity and add diagrams

Ethereum state on Swarm Track (Viktor)

  • Paused

Research (Daniel, Viktor)

  • focus on the book

DevOps (Svetomir)

  • preparing infrastructure for bee implementation, writing helms chart
  • going to write all the guides on how to run the infrastructure

Incentives (Fabio, Vojtech)

  • documentation for SWAP, should be merged today, this will include some basic deployment as well
  • work is being done on cheque edge cases & other parts of the swap go code
  • behavior for swap-enabled nodes on rsk testnet is being observed
  • research/book of swarm is being reviewed

Business (Viktor)

  • veru joined the team, working on funding the association in Switzerland and Swarm token

Tracks sync 20.01.2020

Core Track (Viktor, Janos)

  • Experimenting with libp2p (Petar, Elad & Janos) github.com/janos/bee
  • Elad working on next minor release

Communication Track (Vojtech)

  • Changed focus from incentives to replacing comms layer for Lumino node (Raiden fork). This will make the adoption of the network much easier as every lumino node will be communications node. We will do the same for the RSK client but probably while tackling incentives already
  • Reading the Swarm book

Adaptive Node Track (Viktor)

Specifications Track (Viktor)

Ethereum state on Swarm Track (Viktor)

Research (Daniel, Viktor)

  • Working on the book

DevOps (Svetomir)

  • Preparing the infrastructure for the more complex testing - more structured and implementation agnostic

Incentives (Fabio, Vojtech)

  • Marcelo & Ralph - making SWAP more robust through multiple PRs, some still in progress
  • Rinke - the book of swarm review & research feedback
  • Fabio - incentivization readthedocs documentation
  • Santi - testnet metrics: checking out matfix, grafana etc, results will be shared through a doc

Business (Viktor)

Tracks sync 23.12.2019

Core Track (Viktor, Janos)

  • work continued on better CMD user experience
  • general error handling improvements

Communication Track (Vojtech)

Adaptive Node Track (Viktor)

Specifications Track (Viktor)

Ethereum state on Swarm Track (Viktor)

Research (Daniel, Viktor)

DevOps (Rafael)

Incentives (Fabio, Vojtech)

Business (Viktor)

Tracks sync 16.12.2019

Core Track (Viktor, Janos)

Communication Track (Vojtech)

  • demo at laBITconf using libp2p with forwarding kademlia and super simple UI
  • decided to continue building both UI and node code. The UI should help drive the needs for the developers who want to use the Comms infrastructure
  • next steps are to focus on incentives

Adaptive Node Track (Viktor)

Specifications Track (Viktor)

Ethereum state on Swarm Track (Viktor)

  • no progress

Research (Daniel, Viktor)

  • full time spent on writing the book
    • rinke on the way to budapest to help
  • aiming to have the main structure/ideas of the book ready by the end of year
  • dani has uploaded the user story about upload and postage stamps

DevOps (Rafael)

Incentives (Fabio, Vojtech)

  • finalized the testing infrastructure - now it is possible to spawn cluster from any commit, it uses shared ganache with prefunded wallets of both ETH and ERC20 tokens
  • next focus probably postage stamps

Business (Viktor)

  • not much progress
  • call with EF on thursday

Tracks sync 09.12.2019

Core Track (Viktor, Janos)

  • fcds (forky) integration and migration (import/export)
  • async protocol message handling (involves correct error handling, preparations for blacklisting)
    • PR will hopefully be ready soon
  • infrastructure documentation update
  • work is being done on the book of swarm

Communication Track (Vojtech)

Adaptive Node Track (Viktor)

Specifications Track (Viktor)

Ethereum state on Swarm Track (Viktor)

  • No movements, might be de-prioritized depending on resources

Research (Daniel, Viktor)

  • Big push regarding the book

DevOps (Rafael)

  • Will focus the next 2 weeks on doing handover documentation and reviewing devops related git repos. Private repos will be moved to keybase.

Incentives (Fabio, Vojtech)

  • doc is being written for the deployment scripts for swap enabled clusters
  • collection of user stories from different POVs for the postage stamps pending

Business (Viktor)

  • Negotiations are moving ahead with Consensys & others

Tracks sync 03.12.2019

Core Track (Viktor, Janos)

  • Currently Elad is not present
  • Handling reported problems in master
  • Preparing GC task for etclabs
  • Louis is working on file hasher
  • changes to bzz address in progress
  • Integration of new chunk store into local store
  • Start changing protocol package to address requests by incentives team
  • Talks will be had for possible candidates in the core team
  • Onboarding documentation is being prepared

Communication Track (Vojtech)

  • (track lead absent)

Adaptive Node Track (Viktor)

  • no updates currently

Specifications Track (Viktor)

  • currently working on the book of swarm

Ethereum state on Swarm Track (Viktor)

  • (same as last 2 sections)

Research (Daniel, Viktor)

  • shared 3 points in research hours call (link)

DevOps (Rafael)

  • (track lead absent)

Incentives (Fabio, Vojtech)

  • deployed swap-enabled cluster, need tests to confirm it's working correctly
    • should be updated after every merge to master
    • waiting on the ERC20 PR to be merged for automation/integration
  • much of the team is involved with IOV/labitconf event
  • dani said he wanted to write the SC for the postage stamps and let someone else to write the go code
    • ralph and rinke should coordinate with dani regarding this issue since it seems the contract has already been written
    • need to sync with vojtěch about the user stories for postage stamps

Business (Viktor)

  • continuing negotiations with strategic partners, progress is slow
  • interview was had last week with potential PO

Tracks sync 25.11.2019

Core Track (Anton, Viktor, Janos)

  • Solving problems that are on the cluster
  • Release 0.5.3

Communication Track (Vojtech)

  • progressing on the libp2p in javascript
  • demo for laBITconf
    • chat similar to the one mad in Madrid by Louis and Atila
    • forwarding cademlia
    • light nodes
    • RSA encryption

Adaptive Node Track (Viktor)

  • we included minimal adaptive node capabilities into 1.0 roadmap
  • Elad and Louis wrote some specs

Specifications Track (Viktor)

Ethereum state on Swarm Track (Viktor)

  • no progress

Research (Daniel, Viktor)

DevOps (Rafael)

  • DNS: swarmresear.ch domain has been transfered over to the ethersphere namecheap account.
  • Kubernetes staging: No more spot instances are being used. You don't need to define the nodeSelector or tolerations anymore.
  • Started working on creating dedicated VM group to deploy Swarm. This will avoid sharing resources with other workloads (e.g. elasticsearch, prometheus, etc..)

Incentives (Fabio, Vojtech)

  • Deployment of SWAP enabled public testnet in progress
  • Now focused on private SWAP enabled network
  • ERC20 enabled PR
    • This generated number of vendored file changes, help requested from Janos
    • Janos's feedback: We should consider removing the vendor folder completely as it is not within our control
  • Browser integration - a lot of open questions, need user stories
  • Number of user stories to be created about Postage Stamps and Market Price

Business (Viktor)

  • Big progress, pitch deck created, tentative release plan, roadmap
  • Budget & Funding plan
  • Active contact with EF and Consensys
  • Meeting with new product owner recommeded by Consensys

Tracks sync 04.11.2019

Core Track (Anton, Viktor, Janos)

  • highest priority is handover for infrastructure
  • continuing to work on the syncing issues
  • improving downloads

Communication Track (?)

  • added forwarding Kademlia to libp2p JS implementation (IOVlabs)

Adaptive Node Track (?)

Specifications Track (?)

Ethereum state on Swarm Track (Viktor)

  • stagnating a bit lately, main focus on core track now
  • doing second iterations on PRs

Research (Daniel, Viktor)

  • discovered an attack vector
  • discussed how to do retrieval incentives - most work on the core team
  • only chunck delivery should be priced, not the request
  • incentives for 1.0 only SWAP & postage stamps

DevOps (Rafael)

Incentives (Marcelo, Vojtech)

Business

  • moving ahead with Consensus - hiring product manager, they offered help with technical writers as well
  • continuing discussion with other strategic partners
  • interview with a candidate for PO last week

Tracks sync 28.10.2019

Core Track (Anton, Viktor, Janos)

  • standing issue is still PSS push integration
  • push sync will be solved (needed coordination between two tracks - Communication (Epic Labs) & Core)
  • Elad working on improving the tags handling in localstore
  • We need to migrate our AWS account

Communication Track (?, update given by Janos)

  • no lead right now, to be tackled soon

Adaptive Node Track (?)

Specifications Track (?)

Ethereum state on Swarm Track (Viktor)

  • no progress
  • still finishing the header chain (finishing phase 0 & 1)

Research (Daniel, update given by Vojtech & Viktor)

  • working on multiple token payments system

Network Testing Framework DevOps (Rafael)

  • AWS migration planning. Swarm should have it's own account so that swarm developers can be granted access to it. Currently we're using an account that is shared across the Ethereum Foundation.
  • Question: Can we rename this section to "DevOps". It should contain updates about any developer tooling/infra related topics. Yes

Incentives (Marcelo, Vojtech)

  • swap factory merged
  • pending cheques under review
  • some business logic issues have been settled with research
    • @core: blacklist mechanism?
      • nothing yet, but has to be specced before implemented
    • we are waiting on Dani's SWIP on multiple blockchains, as this is a priority
  • progress is also being made regarding Oracles (repo here)
  • incentives sim bug has not re-appeared so far
  • although progressing, we are falling behind on open PRs while new issues pop up
  • more of the team is back, only Fabio and Diego are absent now

Tracks sync 21.10.2019

Core Track (Anton, Viktor, Janos)

Communication Track (Louis)

  • Louis has withdrawn from the role of tracks lead and won't be joining these track sync meetings anymore. He will solve tasks assigned to him from now on.
    • Meeting tmrw at roundtable will plan pss/pushsync contention and task priorities concerning pss/pushsync contention, kademlia etc

Adaptive Node Track (Louis)

  • See above. No plans on what to do further with this track for now.

Specifications Track (Louis)

  • See above. Viktor has said he will lead delivery of specs.

Ethereum state on Swarm Track (Viktor)

Research (Daniel)

Network Testing Framework (Rafael)

Incentives (Marcelo)

  • incentives simulations merged
    • syncing bug needs to be squashed (blocking CI on PRs); do-not-merge PR to check builds here
  • retrieve protocol now blocks unsolicited chunk deliveries
  • other complementary/auxiliary improvements: cleanup, tests, logs
  • next milestones:
    • proper error handling
    • security/robustness improvements (factory for swap contract, variable range checking)
  • meeting on wednesday to touch base on:
    • devcon workshop takeaways
    • oracles/multiple-blockchain work
  • almost all of the team will be back this week so progress should accelerate a bit

Tracks sync 30.09.2019

Core Track (Anton, Viktor, Janos)

Communication Track (Louis)

  • Forward cache refactor created problems for push sync stability, needs investigating
  • Asynchronous message handling added to improve performance may need improvements

Adaptive Node Track (Louis)

  • SWIP about how to request connectivity with peers based on capabilities and PSS capabilities both still in review

Specifications Track (Louis)

  • Oskar has reviewed the current pending spec SWIPs. Will attend to comments this week.

Ethereum state on Swarm Track (Viktor)

Research (Daniel)

  • Postage stamps SWIP ready for implementation
  • what needs to be implemented:
    • SC that will accept on chain payments
    • handle (Go module)
    • forwarding part of the node should be updated
  • second part of the postage stamps SWIP (about privacy) is being prepared

Network Testing Framework (Rafael)

  • no major updates, help with set ups

Tracks sync 23.09.2019

Core Track (Anton, Viktor,Janos)

  • Preparation for 0.5 release, biggest blocker is push syncing

Communication Track (Louis)

  • Several PSS stuff has been merged, some of it is being rolled back

Adaptive Node Track (Louis)

  • PRs has been merged, capabilities in kademlia and PSS
  • new SWIP about how to request connectivity with peers based on capabilities, both in review

Specifications Track (Louis)

Ethereum state on Swarm Track (Viktor)

Incentives Track (Fabio, Vojtech)

  • Priority is to generate deployments, we'll have demonstration how to do this on kubernetes later today
  • We'll create SWAP enabled network
  • Issue: currently when we deploy chequebook, it is not prefunded -> needed for Devcon, probably will not make it until next release

Ethereum state on Swarm (Viktor)

  • reviewed PR for phase 1
  • preparing for our talk with Piper and Zahoor:

Research (Daniel)

  • specification for the Postage Stamps is ready for implementation, probably impementation after devcon, Dani would like to participate in implementation
  • Call for developers to read the specifications

Network Testing Framework (Rafael)

  • Integration of the ganache (eth blockchain for testing) helm chart with the swarm helm chart finished.
  • Call with the incentives track to demo a SWAP enabled swarm cluster on kubernetes.

Business

  • Last phase of porting contracts from Dani's company to new structure. Burn rate too high, Dani and Victor cannot take salary. Business talk next Thrusday with a partner who can chip in, Consensys might help as well, talks planned with strategic partners on Devcon.
  • Remark: Victor would like to have a sprint for Devcon to realize 0.5 release. All track leads: decide on what must be in the code before Devcon. - Request for features which will be in the code after Devcon and their oder of importance.

Feedback

  • Elad: There was no onboarding for the SWIPs, it is not clear what the process is. We should introduce it into the team. Elad will schedule a call with Louis, Dani and everyone who is interested on Friday.
  • There will be no release tomorrow because of the performance issues, we take a time until the end of the week

Tracks sync 16.09.2019

Core Track (Anton, Viktor,Janos)

  • Work on push syncing continues
  • porting incentivization into retrieval

Communication Track (Louis)

Adaptive Node Track (Louis)

  • Kademlia capabilities integration PR submitted for review, approved by @zelig, reviewed by Álvaro
  • Next step is enable live change of capabilities, preparation for demonstration at devcon

Specifications Track (Louis)

Incentives Track (Fabio, Vojtech)

  • Creating a series of PRs (improving SWAP code to be more robust)
  • This week want to integrate retrieval protocol and deployment to test network

Network Testing Framework (Rafael)

  • Swarm-private helm chart: Possibility to provide configuration to specific swarm containers: ethersphere/helm-charts#94
  • Started integration of the ganache (eth blockchain for testing) helm chart with the swarm helm chart, so that we can start running deployments with incentives enabled.

Ethereum state on Swarm (Viktor)

  • Merged fix for phase0 PR (bug which didn't allow disconnected nodes to reconnect)
  • Phase1 will be done by Thursday (probably)

Research (Daniel)

  • no updates

Business (Victor)

  • Last phase of porting contracts from Dani's company to new structure. Burn rate too high, Dani and Victor cannot take salary. Business talk next Thrusday with a partner who can chip in, Consensys might help as well, talks planned with strategic partners on Devcon.
  • Remark: Victor would like to have a sprint for Devcon to realize 0.5 release. All track leads: decide on what must be in the code before Devcon. - Request for features which will be in the code after Devcon and their oder of importance.

Feedback

  • Confirmation on not paying for synching (question by Marcello)
  • A: Postage stamp for spam protection, also paying via SWAP.

Tracks sync 09.09.2019

Please all track leaders do a bit of issue grooming and assign good first issue labels to appropriate tasks. There is interest from potential contributors.

Core Track (Anton, Viktor, update given by Janos)

  • focus this week will be merging the new streamer
  • also push syncing PR (to be merged this week or next one)
  • other non-crucial experiments going on

Communication Track (Louis)

Adaptive Node Track (Louis)

  • Still working on inclusion of capabilities in kademlia/discovery, experiencing trouble with RLP serializations in integration tests https://github.com/ethersphere/swarm/pull/1713
  • Submitted proposal 50% of devcon breakout slot about adaptive modes of operations (API plus example involving PSS)

Incentives Track (Fabio, Vojtech)

  • working on tasks from incentives to master PR
  • looking into in-process simulations
    • difficulties simulating w/swap due to back-end URL param, interaction with blockchain, etc.
    • current simulation alternative is not suitable with integration testing
  • multiple PRs open
    • discuss review process during the roundtable

Network Testing Framework (Rafael)

  • skipped, Rafael not present

Ethereum state on Swarm (Viktor)

  • working on bug not caugh by unit tests
  • tests for phase 1 went well

Research (Daniel)

Business (Tim)

  • need stable version of swarm to move ahead

Feedback

Tracks sync 02.09.2019

Please all track leaders do a bit of issue grooming and assign good first issue labels to appropriate tasks. There is interest from potential contributors.

Please don't forget input your latest update to our August newsletter hackmd till 31st August.

Core Track (Anton, Viktor, update given by Janos)

  • Anton is back, plan to tackle new syncing
  • testing environment for incentives
  • push sync - waiting for Anton to review
  • smoke tests on master are failing, work on the sync track though -> request to help disecting master

Communication Track (Louis)

Adaptive Node Track (Louis)

Incentive Track (Fabio, Vojtech)

Network Testing Framework (Rafael)

  • skipped, Rafael not present

Ethereum state on Swarm (Viktor)

  • Phase 1 done

Research (Daniel)

  • focus on SWIP 1 day this week, working on postage stamps

Business (Tim)

  • session with John on setting up Swiss foundation
  • strategic partners sync planned
  • Ethereum foundation milestones presented and generally accepted

Feedback

Tracks sync 26.08.2019

Please all track leaders do a bit of issue grooming and assign good first issue labels to appropriate tasks. There is interest from potential contributors.

Please don't forget input your latest update to our August newsletter hackmd till 31st August.

Core Track (Anton, Viktor, update given by Janos)

  • consolidating for release 0.5 which includes pinning and hopefully new stream (still in PR)
  • PR updating the goethereum packages to new version, there are some problems that need to be solved, this is mostly manual process checking what are the changes but luckilly there are also some failing tests as well.
  • push sync PR, might also be part of 0.5 release

Communication Track (Louis)

  • pss port to swarm simulations approved by lash, need one more
  • pss queue handling improvement will compare two implementations for speed
  • added new issue for p2p/rlp independent serialization in pss (better for spec)
  • Bug-Fixed on the Hashing Algorithm which led to less matched in the cache

Adaptive Node Track (Louis)

  • capabilities api PR still pending approve and merge
  • reformatted spec SWIPs and scripted a bit for the latex->md conversion, and re-submitted now to main repo.

Incentive Track (Fabio, Vojtech)

  • Number of SWIPs ready to propose this week
  • incentives PR to master approved by Viktor and Elad, ready to merge!!!
  • Rinke started to work on the message to honey oracle implementation.

Network Testing Framework (Rafael)

  • Grafana and InfluxDB updated on our helm charts
  • Integrate blockchain (using Ganache) and Swarm (with incentives) on our helm charts (In progress)
  • Possibility to request faster disks (IO1) with more IOPS

Ethereum state on Swarm (Viktor)

Research (Daniel)

  • Reviewed a few SWIPs
  • Setup office hours on every Thursday to discuss any research

Business (Tim)

  • Meeting between Swarm, EF & IOV
  • Meeting between Swarm, EF & Status
  • Meeting Tim + Luis + EF Layer about legal stuff for GMBH

Feedback

  • Status re-iterated they want to be part of incentivisation at least on the research side
  • Incentivization of adoptive nodes should also be considered soon
  • Gitcoin campaign to be created for small javascript task in the Network Testing Framework

Tracks sync 19.08.2019

Core Track (Anton, Viktor, update given by Janos)

  • New Stream fixes and performance improvements
  • Continuing work on tags and pinning and documentation for the upcomming 0.5 release
  • Benchmarking for bossible localstore improvements
  • Adding multi chunk operations for localstore

Communication Track (Louis)

Adaptive Node Track (Louis)

Incentive Track (Fabio, Vojtech)

  • Viktor has made another review to the incentives PR, changes have been applied but there are still points to be resolved
  • According to Fabio, we are expecting another review from Elad (this will be followed up on)
  • 2 SWIPs will be pushed this week - msgHoney oracle and probably the multiple payments but as IOV
    • 2 more will be pushed next week

Network Testing Framework (Rafael)

Ethereum state on Swarm (Viktor)

Research (Viktor)

Business (Viktor)

Feedback

Tracks sync 12.08.2019

Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.

Epics / User Stories
General Updates of the Track
Blockers and Resource planning

Core Track (Anton, Viktor, update given by Janos)

Communication Track (Louis, Vojtech)

Adaptive Node Track (Louis)

  • Progress divided in three sequentially dependent branches. They are currently working and tests passing. However, the first PR was amended after comments to use bool arrays instead of bitflags for storing capabilities, but this is inefficient when comparing caps to each other, so this change should be reverted. Conceptually it need not change.
  • Adaptive SWIP must be rewritten as platform independent spec.
    • Handshake and pss spec will depend on this SWIP.
  • Since noone in the team responded to my request for adding status as reviewers in the SWIP repo, the preliminary discourse is now happening on my own fork https://github.com/nolash/SWIPs/pulls - this is pretty silly, and it's annoying that such a simple little thing needs to be chased so much.

Incentive Track (Fabio, Vojtech)

  • We still have the big PR open, Elad did another review today, there is only a few comments, hopefully will be resolved today
  • Reduced the 5 to 3 SWIPs, in internal review now

Network Testing Framework (Rafael)

  • No change. Nothing to update.
  • SWAP testing on kubernetes: Rafael to discuss requirements with Fabio.

Ethereum state on Swarm (Viktor)

  • Done with Phase 1 (integrations tests to be done)
  • Zahoor will hopefully help this week
  • This week continue to work on Phase 2
  • Track sync call with Piper this Thursday
  • Funding secured through Giveth platform

Research (Viktor)

Business (Viktor)

  • The big kick off call for the legal entities
    • Short term Swarm Foundation, possibly also service company
    • Long term possibly consortium
    • Maybe DAO as well

Feedback

  • Reaction to Status team not being added to the Swarm repo
    • Suggestion from Viktor: We should dedicate someone who is responsible for this admin stuff and devops
  • Question about Adaptive notes: There is a need in the Incentive team to negotiate things like prefered payment solutions at handshake - should this be reflected in the adaptive nodes SWIP?
  • There has not been updates from the Network Testing Framework, what is the status?
    • (lash) Q: would like to know eg can I with CURRENT state of framework create a remote node test with pss nodes sending and receiving messages?
      • (rafael) A: Yes, any exposed RPC calls (also the ones for PSS) can be executed. See this example.
  • Milestone for Ethereum foundation: How important it is? With Rafael & Anton on holidays leading to the delivery,
    • (vik) let's push for the delivery by the end of August
    • (lash) when we define milestones there should be some degree of "celebration" on reaching them. otherwise it feels more like a "hurry up and wait" trap, which is anti-climactic and can easily be detrimental to morale
  • New developer for incentives
  • SWIP workflow - can we work on the branch of SWIP repo rather than creating fork and working there? Because if not we need to replicate the access rights to the repo.
    • (viktor) Encourages working directly in the ethersphere repo on a separate branch

Tracks sync 05.08.2019

=======
Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.

Epics / User Stories
General Updates of the Track
Blockers and Resource planning

Core Track (Anton, Viktor)

Communication Track (Louis, Vojtech)

Adaptive Node Track (Louis)

  • PR for caps protocol still under review, one reneg (vik) one approval (elad) so far.
  • Updated original adaptive node caps proposal in new SWIP format
  • It is now again very unclear who is responsible for what. For example; the Status project main aim is spec of swarm node, I'm the contact for Status, but responsibility or the specs are placed in research track, making me responsible for something I have little influence over. I don't want that. This needs to be cleared up.
  • Next week Dean and Oskar is coming to Berlin next week and we will hack together

Incentive Track (Fabio, Vojtech)

  • Tension: most decisions are made in the research team but Fabio is responsible for implementation. Most of the questions outsourced to research, sometimes slow but wokrs so far.
  • Still working on the big incetives to master PR, currently requested changes from Viktor, but Elad is in India and his internet connection is cut. This means the PR might be blocked until he gets online.
  • Marcelo handling Viktor's comments today, number of open PRs by Rinke to be reviewed
  • Fabio working on simulations on the side, we can use in process simulation which is nice
  • SWIP call about SWAPs. Next steps: unify some of them, make PRs, break down to issues.

Network Testing Framework (Rafael)

Ethereum state on Swarm (Viktor)

Research (Viktor)

Business (Viktor)

  • launch legal/funding/intitutional strategy working group

Feedback

  • It is unclear if the SWIP for adaptive nodes needs to be reapproved

Tracks sync 29.07.2019

Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.

Epics / User Stories
General Updates of the Track
Blockers and Resource planning

Updates structure
Communication Track (Louis, Vojtech)
Core Track (Elad, Viktor)
Incentive Track (Fabio)
Network Testing Framework (Rafael)
Research (Daniel)

Other
Network-Testing
Release Planning
Documentation

Core Track (Anton, Viktor)

Communication Track (Louis, Vojtech)

This includes SWIPS for:

  • SWIP: General P2P Specc (P2P Communication assumptions)
  • SWIP: The HIVE Protocol (Wire-Protocol Specification + Bootstraping Strategy)
  • SWIP: Kadelmia + Routing
  • SWIP: PSS Wire Spec
  • SWIP: PSS API Specification

Milestone 2: Adaptive nodes (client and server) specs

  • Including light node connection strategy

Milestone 3: BZZ spec (possibly divided into get and post phases)

  • SWIP: Retrieval Wire-specification / Fetching
  • SWIP: Stream Protocol
  • SWIP: Syncing Protocol
  • SWIP: HTTP Interface

Milestone 4: BZZ incentives spec

  • SWIP: SWAP (P2P Accounting)
  • considering rewiring pss, making crypto/handshakes pluggable, move whisper out to "plug" or eliminate
  • pss spec reviewed by vik, implemented in PR, waiting for confirmation - also awaiting feedback from iovlabs and status on the textx
  • Comm track will be split up in Comm track and Adaptive nodes track from now on (louis heads both)

Incentive Track (Fabio, Vojtech)

  • scheduled to promote the open PR from incentives to master on Friday, delayed due to bugs
  • last PR to incentives branch, good to go after
  • blockers:
    • how to run simulation for tests (blockchain simulation)
  • number of SWIPs to be shared this week

Network Testing Framework (Rafael)

  • Initial PR merged #1555
  • Retry mechanism for Exec Adapter when there is a UDP port collision #1616. Thanks @nonsense
    • We should get rid of go-ethereum p2p discovery and the UDP server altogether, but this is a bigger effort.
  • Next steps: Refactor "upload and sync" smoke test to also work with the framework.

Research (Viktor)

  • trying to get to Dani will write the two promised

Ethereum state on Swarm (Viktor)

  • Moving ahead, Viktor is implementing the Phase 1 & 2
  • This track got some charitable donors, so we have funding to put resources on this track
  • Most likely will work with Epic Labs to add resources to the team soon

Business (Viktor)

  • work to move ahead with Swarm foundation
  • consolidating collaboration with Status.im, mainly focuses on writing the specs and completing them by the end of December

Feedback

  • Louis: the Communications track is refering to both communications and adaptive nodes which is confusing, maybe those should be split into tracks both in the hands of Luis. Encouragement to split these two
  • Marcelo: how to handle the comments from reviewers on the incentives PR? Consensus: make the commit changes directly to the incentives branch.
  • How to handle big PRs?
    • Maybe we can split them into chain of PRs with rebasing in the middle. Danger with splitting is that sometimes the code in PR is not even used.
    • Maybe setting up maximal size per PR?
    • Conclusion => lets aim for digestable size of PRs
  • Suggestion for the incentives branch. Split into 3 PRs:
    • PR removing legacy code
    • PR adding autogenerated code from smart contracts
    • PR with all the new code

Tracks sync 22.07.2019

Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.

Epics / User Stories
General Updates of the Track
Blockers and Resource planning

Updates structure
Communication Track (Louis, Vojtech)
Core Track (Elad, Viktor)
Incentive Track (Fabio)
Network Testing Framework (Rafael)
Research (Daniel)

Other
Network-Testing
Release Planning
Documentation

Core Track (Anton, Viktor)

  • Pull Sync should be finalised this week / early next week
  • PSS is open Pull sync - louis will address open questions
    • Upload of 1 GB and Download was possible with 40 Swarm-Nodes (only with push sync, no pull sync)
  • Small improvements have been done on API endpoints
    • Small improvments on testing
    • Structured output of Kademlia table per node
  • Blocker: PSS (due to Push Sync being dependent on it)
  • No update on Kademlia improvements
  • No update on Download improvements

Communication Track (Vojtech)

  • Louis just came back from vacation
    • Brief update with Status -
    • Short discussion Adaptive Node Track / Comm-Track
      *
  • Vojtech - IOV is commited to use to PSS and would like to support the adaptive node track with Status

Incentive Track (Fabio, Vojtech)

  • PR to master should be ready by EOW (ready or merged)
    • Open questions about details
  • Idea to create a SWIP for the SWAP part
  • OPEN QUESTION: L2 Smart-Contracts for Pinned conntent (with Zahoor) maybe Rinke and Rafael could start looking into that after completing the SWAP smart contracts? (Tim)

Network Testing Framework (Rafael)

  • Initial snapshot feature inside PR#1555
  • Missing Tasks for the Framework
  • Louis Q: RPC Call which need to be included - whats the status on this?
    • "These" RPC Calls for Debugging or other purposes - are there any changes? Or is this future work? (Louis)
    • Anton answer: There is structured output on kadelmia. There are other ideas how to make simpler tests for the future. PR#1586
    • Rafael answer: That RPC call is also useful to test the snapshot feature
  • Fabio question: Is this a proxy? What do I know to review the RPCs?
    • Rafael: RPC via RPC call fuction. This is worked on. Some is already there for the BZZ client.
    • Fabio: How to check balance?

Research (Viktor)

  • Session with Dani, Aron and Viktor
  • Fabio: Useful input to fullfill the current needs of the incentive track.
  • Viktor: How can we combine posted stamps + swap profitability - writeup TBD
  • Viktor: Fetcher timeout vs 404 if a chunk is not found - writeup TBD
    • Current Fetcher is not incentive compatible

Business (Tim)

  • Ethereum Foundation supports the creation of a Swarm Foundation (Timeline aiming for October / November to create the Swarm Foundation)

Feedback

  • Upfront summary written by track-lead would be useful
  • Review of the notes should also be done by the track-lead if not written by themselves

Tracks sync 15.07.2019 (Written Feedback)

Please provide your written feedback to give an update about the current status of the track as well as writing down blockers and risks which need to be addressed from other dependent tracks.

Epics / User Stories
General Updates of the Track
Blockers and Resource planning

Updates structure
Communication Track (Louis, Vojtech)
Core Track (Elad, Viktor)
Incentive Track (Fabio)
Network Testing Framework (Rafael)
Research (Daniel)

Other
Network-Testing
Release Planning
Documentation

Network testing (Rafael)

  • Initial PoC with Exec/Docker/Kubernetes adapters is working: Draft PR
  • Written a discovery test using the new framework. Works on all 3 adapters.
  • I will create a list of remaining tasks for the implementation of missing features and attach it to the epic#33

Incentive track (extraordinarilly by Vojtech)

Hack week achievements:

  • Implemented simple SWAP happy path only (=not handling edgecases, blockchain errors etc).
    Happy path SWAP
  • In terms of the metrics document (strikethrough items were planned but not achieved):
    • Admins can query node’s balances book through API
    • Nodes deploy SWAP smart contract and deposit as they go online (if not already) and this is stored in persistent storage
    • (ideally) Nodes replenish the SC with hardcoded value…
    • Nodes issue cheques to each other including the SWAP SC address
    • Cheques are cashed out immediately as they arrive, these are 2 calls
      • Submit cheque
      • Cash out cheque (after delay allowing challenge)
    • (ideally) automated (local) testing which deploys 2+ nodes and simulates manual traffic
    • Integration with the new syncer
  • You can try it on incentive branch (with custom network) by running: swarm -swap -swap-api=https://rinkeby.infura.io but make sure you have some rinkeby eth
  • List of assumptions and decisions made
  • Increase a familiarity with a go code and reponsibles/experts for individual parts
  • Established communication with the Swarm team
  • 3 new epics/user-stories
  • End-do-end test contract test with simulated backend

Lessons:

  • It is difficult to coordinate with track lead who is not physically present and it creates delays and tensions. For the next time we should make a separate branch for the hack week that is then merged.

TODO:

  • Number of new issues to tackle
  • Polish the incentives branch and prepare merge to master (this includes a bigger discussion and implementing things like #1550)

Blockers:

  • Still unclear how will research decisions be finalised

Eth on swarm

  • successful handshake between trinity and swarm
    phase 0 of the epic is dev ready
  • Elad and Viktor submit first bzzeth PR
  • iteration on epic
  • to write up incentive aligned strategy to handle newblock header hashes
  • start work on phase 1

Blockers

protocols.go message wrapping causes incompatibility
https://github.com/ethersphere/swarm/issues/1575

Core track

  1. Push sync / PSS
  1. Pull sync
  • improved existing tests
  • added live and combined live and history test cases
  • added benchmarks (which turn out to be not so reliable)
  • defined more test vectors
  • integrated new retrieval and streamer onto swarm.go and started running integration tests
  1. Efficient download
  • no progress
  1. Kademlia improvements

Tracks sync 01.07.2019

Note: Session will hopefully be recorded.

This is a holiday for some of the team. Participation is optional. Session will be recorded.

Agenda:

General Updates of the Track

  • Epics / User Stories
  • Blockers and Resource planning
    General discussion

Updates structure

Communication Track (Louis, Vojtech)
Core Track (Elad, Viktor)
Eth on Swarm (Vik)
Incentive Track (Fabio)
Network Testing Framework (Rafael)
Research (Aron)

Other

Network-Testing
Release Planning
Documentation

Communication Track (Louis, Vojtech)

Swarm Improvement Proposal (SWIP)
Currently no real blockers, did not hear from Status yet for both the proposal nor the specs.

Core Track (Elad, Viktor)

Vik submit pr to push sync branch - problems sim framework

  1. anton and vik disagree on implementation
  2. fix bug which makes test pass

hopefully merge after next review
http download is reading in sync batch, but could do parallell req instead, creates unnecessary latency.
Elad making good progress on pull sync, anton helping reviewing
Janos is back, being assimilated
Hopefully with better traceability, if chunk is not synced, better understand where failed
Board is up to date

Eth on swarm

telegram group set up, bridged to mattermost
epic finalized for header chain, 3 phases set up, will be made to user stories
upcoming task: come up with user stories for the epics/phases
https://github.com/ethersphere/user-stories/issues/9

Incentive Track (Fabio)

No much happened on board.
Rinke 100% and Ralph 40% are officially working
First done task: drop submitcheque…
Flow diagram how messages will be handled
Discussion and new questions:
https://github.com/ethersphere/swarm/issues/1506
more integrated process working with research, aron not on github how to poke, dani good session 1-2 weeks. need more than one session per week. Better to have official protocol - get attention and address research stuff
fabio worked on cheques exchange protocol - where get private key, there is legacy code, went through with vik to decide what to prune, => rabbit hole, addresses a lot of different interrelated things so may be a longer task.

3 SWIPs in work:

  • Payment mechanism - proposal how multiple payment solutions could work together (own payment channel implementation, lumino/raiden…)
  • how to handle advances ui that includes payment + upload (right now we have simple gateway to just download files)
  • JS libraries with support for incentive

Network Testing Framework (Rafael)

  • Tried using exec/docker adapters on existing tests and failed
  • Comming up with an alternative approach
  • Proposal to be done on tomorrow's Roundtable (02.07)
  • rafael will sync with janos

Research (Aron)

  • Had several discussions (Aron & Dani, or Aron, Dani & Viktor). Daniel is working on an exhaustive list of anticipated node interactions and their incentive compatibility. Key questions involved syncing and lottery and their relation to xor distance in most proximate nbhd.
    Ideas discussed are payment-via-lottery to avoid the 'burn' in postage. Incentive compatibility of pay-for-sync. Future transition of postage to storage insurance.
    Dani will post his writeup to swarmresear.ch later today.

Entanglement codes research collaboration

Had call Vik Aron
Submit talk to Devcon
Found some issues not covered
Will be writing EPIC (when?)
In order for it to be proper track, needs to tackle chunker, probably not be very soon

Documentation

Is a separate track, but there is no lead yet.

Discussion

  • Sync with research. Was meeting set up thursday two weeks ago. Dont know why. had last thursday also, not all present.
    • research channel in mattermost for quick question - to draw attention to a need / topic
    • mattermost is emphemeral, gets lost if time passes. not for permanent decisions.
    • treatment, conclusion, decision -> swarmresear.ch
  • Need a source-of-truth document! <- this is the most important, get this started.
  • calls are a good medium to involve as many research ppl as possible, we need a way to document decisions we make
  • more reliable way for back-and-forth
    • ex threshold handling, when should drop peers? also affects other protocols, should be agreement on when to drop peers and what are the repercussions.
  • when is should be elevated to the research group, what can be replied directly from single member. usually just post to research channel, if noone says something it.
  • we seem to converge on:
    • mattermost for get attention
    • swarmresearch for discussion if question that needs treatment
    • stored in a "formal" document (where? need to decide) when finalize
Select a repo