Business Intelligence Data Engineer

Job Summary & Responsibilities:

At Motor Trend Group data is central to measuring all aspects of the business, and critical to its operations and growth. The BI data engineering team is responsible for collecting, analyzing and distributing data using public cloud and open source technologies and offers transparency into customer behavior and business performance

Responsibilities:

• Collaborate with product teams and data analysts to design and build data-forward solutions
• Build and deploy streaming and batch data pipelines capable of processing and storing petabytes of data quickly and reliably
• Integrate with a variety of data metric providers ranging from advertising, web analytics, and consumer devices
• Build and maintain dimensional data warehouses in support of business intelligence tools
• Develop data catalogs and data validations to ensure clarity and correctness of key business metrics
• Drive and maintain a culture of quality, innovation and experimentation
• Deliver strong Python and SQL development and maintenance techniques surrounding data movement to include technologies
• Investigate and understand different data sources and ability to connect to a wide variety of 3rd party APIs
• Design, enhance and implement ETL/data ingestion platform on the cloud
• Development of ETL source and target mapping design/specifications based on the business requirements. Create ETLs/ELTs to take data from various operational systems and create a unified/enterprise data model for analytics and reporting
• Develop load and transformation processes in support of the requirements, validate that they meet business and technical specifications, manage ongoing maintenance of the system and data, and make recommendations for process improvements to optimize data movement from source to target
• Provide production and operational support to existing ETL jobs. Monitor and manage production ETL jobs to verify execution and measure performance to assure ongoing data quality and optimization of the system to manage scalability and performance and identify improvement opportunities for key ETL processes.
• Strong troubleshooting and problem-solving skills in large data environment
• Capable of investigating, familiarizing and mastering new data sets quickly

Education/Experience:

• Bachelor’s degree – Computer Science or equivalent
• Strong background in scripting language using Python, Bash, Perl, PHP or any other language to solving data problems
• Experience with relational SQL and NoSQL databases, including Postgres, ,Neo4j and MongoDb
• Experience with Big Data tools; Hadoop, Spark, Kafka,py-spark etc
• Proficiency with the AWS cloud services : EC2, EMR, RDS, S3, Redshift (spectrum) ,Athena
• Proficiency with data exchange types and protocols (json, xml, soap, rest)
• Experience with Stream Processing systems: Storm ,Spark-Streaming etc
• Experience with BI tools like Tableau or any other open source BI tools etc.

Knowledge, Skills, & Abilities:

• Knowledge of the Python data ecosystem using pandas and numpy
• Data integration tools
• Proficiency in SQL, data modeling, and data warehousing
• Excellent problem solving skills
• Exposure to cloud platforms (preferably AWS)

Physical Requirements:

• The ability to sit for prolonged period of time and view computer screen.

Equipment/Software Used:

• Microsoft Office Suite (Outlook, Word, Excel, PowerPoint)
• SQL, MySQL or other relational databases
• Linux, Python, AWS Stack (EC2,EMR S3, Redshift),Athena,Google Bigquery
• Tableau or any other data visualization tool
• SiteCatalyst (Omniture)/Google Analytics or any other web analytics tools experience (Nice to have)

Work Environment:

• Work is performed in an office environment that is well lit and ventilated.

NOTE: This position description reflects management’s assignment of essential functions; it does not prescribe or restrict any other tasks that may be assigned.

In compliance with local law, we are disclosing the compensation, or a range thereof, for roles that will be performed in California. Actual salaries will vary and may be above or below the range based on various factors including but not limited to location, experience, and performance. The range listed is just one component of MotorTrend's total compensation package for employees. Pay Range: $90,500.00 - $160,500.00 salary per year. Other rewards may include annual bonuses, short- and long-term incentives, and program-specific awards. In addition, MotorTrend provides a variety of benefits to employees, including health insurance coverage, an employee wellness program, life and disability insurance, a retirement savings plan, paid holidays and paid time off (PTO).