Spark/Scala CodeMentor Job Description === Whatssap Contact: +1 650 695 7152 email: ask4med@gmail.com **Work hours for candidate:** US Central time: 10 AM to 5PM **Location of work for candidare:** Online/Zoom Remote Contorl. Good Internet connection required. **OS:** Unix/Linux, Windown required. **TASK** I'm looking for someone with spark, scala, or Python expertise to assist with the development of scalable applications Monday through Friday. The tasks will be broken down into 2 weeks' sprints. We will work on a Jira ticket, address code changes, unit tests as needed, test, and plan a demo. We will have two weeks to finish the entire process. The ideal engineer will be compensated on a flat rate every Monday. At time we work on python or java related small project. Speak: English, Good commmunication skill. Skill: * Expert in Scala, Spark, Python, Java, Maven, SQL, GIT, BITBUCKET * Hadoop, Data Engineering, Data Science, Databricks * Scala (with a focus on the functional programming paradigm) * Scalatest, JUnit, Mockito, Maven, Intelij IDEA * Good understanding of function programing * Apache Spark 2.x and 3.x * {{ Apache Spark RDD API }} * {{ Apache Spark SQL DataFrame API }} Responsibilities 1. Create Scala/Spark jobs for data transformation and aggregation 3. Produce unit tests for Spark transformations and helper methods 4. Write Scaladoc-style documentation with all code 5. Design data processing pipelines