Senior Data Engineer (GCP)
Company
The Nerdery
Location
Remote
Type
Full Time
Job Description
About Nerdery and Being a “Nerd.”
Nerdery is a digital product consultancy. Much more than consultants, we’re allies and guides on our clients’ digital journey – helping them to grow their business and delight their customers through intuitive, thoughtfully designed technology. As true partners, we prepare our clients for the opportunities in front of them, help them achieve their goals, and quickly deliver value for their customers. We do this by solving problems in creative ways across strategy, design, and technology.
At Nerdery, we’re not defined by our job titles but by the impact we make. You’ll work directly and closely with some of the world’s best brands to help create innovative digital products that serve everyone. As Nerds, our insight, innovation, and expertise are celebrated, and our growth is not only encouraged but expected. Being a Nerd means stepping up and pushing the boundaries of what’s possible. We’re curious, fearless (well, not totally fearless – there are heights and spiders, after all), and always our authentic selves.
We are looking for a Senior Data Engineer (GCP) to join our team! We invite you to check out the details below and consider whether becoming a Nerd is the next step in your career journey.
The Senior Data Engineer is a technologist passionate about data in all forms — whether stored within a relational database, a data warehouse, a data lake, a lakehouse or in-transit in ETL pipelines. They independently produce capable data structures and performant queries. As a Senior Data Engineer at Nerdery, you will architect and implement data solutions from scratch to extract and land data from various sources that will deliver insights, visualizations, or better predictions for our clients. You will support our software development teams, data analysts, and data scientists using market-relevant products and services.
What Things Will You Do As A Nerd?
- Using complex SQL knowledge and experience, will work with relational databases, Big Query, query authoring (SQL), and working familiarity with various databases.
- Data Transformation & Aggregation:Â Proven ability to leverage BigQuery SQL for implementing ELT (Extract, Load, Transform) processes and performing complex data aggregations.
- Â Looker Optimization: Experience supporting and optimizing Looker dashboards based on BigQuery datasets, including tuning for optimal performance with complex visualizations.
- BigQuery & Vertex AI Integration:Â Familiarity with integrating BigQuery and Vertex AI for advanced analytics and machine learning applications.
- Data Access & Security:Â Knowledge of and experience applying appropriate IAM (Identity and Access Management) roles within Google Cloud Platform to ensure fine-grained data access and security.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other critical business performance metrics.
- Design and implement scalable and reliable data pipelines on GCP.
- Implement Change Data Capture (CDC) techniques and manage Delta Live Tables for real-time data integration and analytics, ensuring data consistency and enabling incremental data updates in cloud-based data platforms.
- Design, configure, and manage Data Lakes in GCP, utilizing services like Google Cloud Storage, BigQuery, and Dataproc, to support diverse data types and formats for scalable storage, processing, and analytics.
- API architecture design, including RESTful services and microservices, integrating Machine Learning models into production systems to enhance data-driven applications and services.
- Build the infrastructure, using IaC, required for extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL and GCP
- Migrate and create data pipelines and infrastructure from AWS or Azure to GCP.
- Write and maintain robust, efficient, scalable Python scripts for data processing and automation.
- Use a strong understanding of data pipeline design patterns, and determine the best for the use case.
- Work with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- Manipulate, process, and extract value from large, disconnected datasets.
- Work with stakeholders, including the Executive, Product, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs.
- Assume responsibility for the stability of the data in transit and at rest
- Collaborate directly with the client to identify and implement data security and compliance requirements. Keep client data secure using best practices.Â
- Foster cross-functional collaboration as a technical liaison between engineering and other project disciplines (Design, Quality, Project Management, Strategy, Product, etc.)
What Skills Will Help You Be A Successful Nerd?
- Bachelors in Computer Science or related field or equivalent experience required
- 6+ years of relevant experienceÂ
- In-depth knowledge of Google Cloud Platform (GCP) data services such as BigQuery, Dataflow, Dataproc, and Pub/Sub, with proven experience in designing and implementing data pipelines, data storage, and analytics solutions in GCP.
- Ability to take technical requirements and produce functional code
- Experience with Git and specified technologies.
- Proficiency in Python and SQL.
- Experience with migrating data pipelines and infrastructure to GCP from multiple infrastructure stacks.
- Deep understanding of data modeling, ETL processes, and data warehousing principles.
- Familiarity with data pipeline orchestration tools and practices, such as Pub/Sub, Streaming, and Cloud Functions.
- Excellent problem-solving and analytical skills.
- Ability to communicate with technical and non-technical client stakeholders
- Proactive collaborator works with colleagues to improve their technical aptitude
Are We the Right Fit For You?
The best way to get the scoop on whether Nerdery is the right place for you is to chat with current Nerds. We would be delighted to have a conversation with you and share insight into what it’s really like to work at our organization and if it’s a place where you can thrive. Our interview process will provide you ample opportunity to talk with other team members and assess whether the role is a good fit for your next chapter. Take the first step and apply today – our Talent Advocates will then reach out to you to get the ball rolling!
Must be legally authorized to work within the country of employment without sponsorship for employment visa status.
Nerdery is an equal opportunity employer and complies with all applicable federal, state and local fair employment practice laws. Nerdery strictly prohibits and does not tolerate discrimination against employees, applicants or any other covered persons because of race, color, religion, creed, national origin or ancestry, ethnicity, sex, sexual orientation, gender (including gender nonconformity and status as a transgender or transsexual individual), pregnancy, marital status, familial status, age, physical or mental disability, citizenship, past, current or prospective service in the uniformed services, genetic information, membership or activity in a local human rights commission, status with regard to public assistance or any other characteristic protected under applicable federal, state or local law. All employees, other workers and representatives of Nerdery are prohibited from engaging in unlawful discrimination. Nerdery will ensure that all employment practices are free of such discrimination. Such employment practices include, but are not limited to: hiring, promotion, demotion, transfer, recruitment or recruitment advertising, selection, layoff, disciplinary action, termination, compensation, benefits, selection for training, including apprenticeship and other terms and conditions of employment. Nerdery will also provide reasonable accommodation to applicants and employees with disabilities pursuant to all applicable laws.
Date Posted
12/06/2024
Views
0
Similar Jobs
Account Manager, Care Partnerships - Headway
Views in the last 30 days - 0
Headway a mental health care company founded in 2019 aims to revolutionize mental healthcare by building a national network of providers accepting ins...
View DetailsDirector of Pricing - Garner Health
Views in the last 30 days - 0
Garner Health is a rapidly growing company backed by toptier venture capital firms Their mission is to transform the healthcare economy by delivering ...
View DetailsDirector, Product, Customer, and Lifecycle Marketing - Garner Health
Views in the last 30 days - 0
Garner Health is seeking an experienced Product Marketing Leader to join their team The ideal candidate will lead the product marketing efforts focusi...
View DetailsLinux Support Engineer - Voltage Park
Views in the last 30 days - 0
Voltage Park is seeking a Linux Support Engineer for a fulltime remote position The ideal candidate will have command line level Linux sys administrat...
View DetailsData Analyst - Agero
Views in the last 30 days - 0
Agero a leading B2B whitelabel provider of digital driver assistance services is revolutionizing the vehicle ownership experience through datadriven t...
View DetailsDirector, Product (Remote) - Dscout
Views in the last 30 days - 0
Dscout is a leading company in experience research technology offering a platform for major companies to gain insights into user needs and behaviors T...
View Details