Big Data Cloud Developer

Create multiple ETL mappings to source data from SQL Server into mart model. Perform several POCs in AWS Glue and Pyspark to parse position-based files. Analyze and design ETL processes to transform, validate and load diverse data formats into AWS. Develop, test, and deploy a Generic Masking Spark based code framework. SPARK, SPARK-SQL, SPARK DF, Snowflakes, Spark Scala, Python, GIT, Jenkins, Data Pipelines, GCP, UNIX Shell Scripting, HIVE, AWS S3, AWS Athena, Oozie, GIT, IntelliJ, SQL Server, Amazon Redshift, PL/SQL, Oracle Forms, SVN, ADF, Amazon Redshift, Netezza, SQL, and UNIX Shell Scripting. Work on thorough debugging using YARN UI/logs during job execution and work on utmost critical story by understanding STM requirement. Lead offshore team ensuring deliverables; pro-actively work to help resolve issues faced by the team leveraging strong analytical skills and technical proficiency, and responsible for a successful execution and closure. Deliver critical business, operational and regulatory reports along with several data sets prepared by ingesting data out of source systems, used for ad-hoc and advanced analytics use cases. Work with Data Designer on data profiling and business functionality understanding, to introduce new data/tables in the reporting and curation layer along with the data reconciliation between source and target. Develop oozie XML jobs, implementing the FORK and Sequential execution mode. Involve in Sprint Planning, provide Story Point Estimation. Formulate and defined system scope and objectives through research and fact-finding to develop or modify moderately complex information systems. Optimize performance of Informatica mappings by analyzing the session logs and understanding various bottlenecks. Create or review technical design documentation to make sure accurate development of reporting solutions. May require travel/relocation to unanticipated work locations within the USA.

Require master of science in computer science/engineering, computer/management information systems/technology, or related field and 3 years of experience in the job offered, software engineer/developer, data architect/engineer, systems engineer/consultant, or related field. In lieu of the above, we will also accept bachelor of science in computer science/engineering, computer/management information systems/technology, or related field and 5 years of progressively responsible experience in the job offered, software engineer/developer, data architect/engineer, systems engineer/consultant, or related field. We will also accept any suitable combination of education, training and/or experience.

Please mail your resume to Maruthi Technologies, Inc, 14911 Quorum Drive, Suite 390, Dallas, TX 75254