Sr. Data Engineer -Spark(EMR),Python, Snowflake
Job Description
Duration: 12 Months
Location: Hillsboro, OR (On-Site Preferred)
Key Skills: Python, Spark(EMS), SQL, AWS/Snowflake/Airflow.
Requirements:
- MS/BS degree in IT or related field
- 6+ years of relevant working experience
- Experience with Financial data and systems
- Strong experience in Python, Spark, Airflow, etc.
- Strong experience with Cloud Data Stacks (AWS, Snowflake, etc)
- Strong understanding of data structures and algorithms
- Strong understanding of solution and technical design
- Strong problem solving and analytical mentality
- Able to influence and communicate effectively, both verbally and written, with team members and business partners
- Able to quickly pick up new programming languages, technologies, and frameworks
- Advanced experience building cloud scalable, real time and high-performance data lake solutions
- Experience with relational SQL
- Experience with scripting languages such as Shell, Python
- Experience with source control tools such as GitHub and related dev process
- Experience with workflow scheduling tools
- In-depth understanding of micro service architecture
- Strong understanding of developing complex data solutions
- Experience working on end-to-end solution design
- Excellent written and verbal communication skills
Responsibilities:
- Design and build reusable components, frameworks and libraries at scale to support analytics products
- Design and implement product features in collaboration with business and Technology partners
- Anticipate, identify and tackle issues concerning data management to improve data quality
- Clean, prepare and optimize data at scale for ingestion and consumption
- Drive the implementation of new data management projects and re-structure of the current data architecture
- Implement complex automated workflows and routines using workflow scheduling tools
- Build continuous integration, test-driven development and production deployment frameworks
- Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards
- Analyze and profile data for designing scalable solutions
- Solve complex data issues and perform root cause analysis to proactively resolve product and operational issues
- Lead by example and mentor other data engineers in adopting standard methodologies
Please apply online.
Please visit https://mavensoft.catsone.com/careers/?portal= for additional job openings
Date Posted
09/13/2022
Views
0
Similar Jobs
IT Engineer - DAT
Views in the last 30 days - 0
DAT is seeking a strong IT Engineer to join their growing technical team and drive the evolution of their technology infrastructure and end user exper...
View DetailsSoftware Engineer - DAT
Views in the last 30 days - 1
DAT is looking for a Software Engineer to join their team in Beaverton OR or Denver CO The role involves working in a full stack TypeScript ecosystem ...
View DetailsSenior Structural Engineer - HDR
Views in the last 30 days - 5
HDR is a company that specializes in engineering architecture and construction services They believe in diversity and collaboration and offer employee...
View DetailsSenior Frontend Engineer - ICIS
Views in the last 30 days - 0
Cirium is a company that provides data and aviation analytics solutions to various industries They are looking for a senior frontend software engineer...
View DetailsSoftware Engineer (Mid-level) - Act-On Software
Views in the last 30 days - 7
ActOn is a leading marketing automation company looking for a Software Engineer to join their team The company offers a supportive and fun culture com...
View DetailsAssociate Actuary - Unum
Views in the last 30 days - 6
Unum offers a comprehensive employee benefits package including competitive benefits generous PTO and opportunities for career advancement The company...
View Details