---
# System prepended metadata

title: Spark/Scala CodeMentor Job Description

---

Spark/Scala CodeMentor Job Description
===
Whatssap Contact: +1 650 695 7152
email: ask4med@gmail.com


**Work hours for candidate:** US Central time: 10 AM to 5PM 
**Location of work for candidare:** Online/Zoom Remote Contorl. Good Internet connection required.

**OS:** Unix/Linux, Windown required.

**TASK**
I'm looking for someone with spark, scala, or Python expertise to assist with the development of scalable applications Monday through Friday. The tasks will be broken down into 2 weeks' sprints. We will work on a Jira ticket, address code changes, unit tests as needed, test, and plan a demo. We will have two weeks to finish the entire process. The ideal engineer will be compensated on a flat rate every Monday.

At time we work on python or java related small project.


Speak: English, Good commmunication skill.

Skill:
* Expert in Scala, Spark, Python, Java, Maven,  SQL, GIT, BITBUCKET
* Hadoop, Data Engineering, Data Science, Databricks
* Scala (with a focus on the functional programming paradigm)
* Scalatest, JUnit, Mockito, Maven, Intelij IDEA
* Good understanding of function programing
* Apache Spark 2.x and 3.x
* {{ Apache Spark RDD API }}
* {{ Apache Spark SQL DataFrame API }}


Responsibilities
1. Create Scala/Spark jobs for data transformation and aggregation
3. Produce unit tests for Spark transformations and helper methods
4. Write Scaladoc-style documentation with all code
5. Design data processing pipelines