Staff Data Engineer

About SecurityScorecard

SecurityScorecard is an industry-leading cybersecurity company backed by Google, Sequoia, and Riverwood. Our mission is to make the world a safer place. We measure your and your vendors' cyber-health by assigning a security rating of "A" through "F" based on outside-in, non-intrusive data. Our Comprehensive security ratings, advanced data analytics, and actionable insights discover Third-Party Vulnerabilities & Security Gaps In Real-Time.
Headquartered in NYC with over 270+ employees globally, raised over $110M USD, used by 1,000+ enterprise customers, and rating 1.6 million companies. We have created a new category of enterprise software, and our culture has helped us be recognized as one of the 10 hottest SaaS startups in NY for two years in a row.
Our vision is to create a new language for companies and their partners to communicate, understand, and improve each other’s security posture.

About the team

As a part of the Attribution team, you will design and implement systems for ingesting, transforming, storing, and delivering data from a wide range of sources at scale (many billions of records per day), to enable us to associate domains, networks and IPs to companies on a continuous basis.

What you will do

• The ideal candidate would be someone who has significant experience building, refactoring and maintaining complex data pipelines using the latest technologies. We are in the process of reengineering our existing pipelines to improve performance, eliminate batch processes, and increase the sophistication of our machine learning models.
• To be successful long term, you’ll need to have or rapidly develop domain expertise regarding how the internet works. The Attribution team is our reservoir of domain knowledge regarding DNS, WHOIS, routing, etc. and you will work in close collaboration with the Data Science and Threat Intelligence teams to build effective algorithms and models that scale.
• Make recommendations regarding technologies, improvements to data models, and processes taking into account, cost, complexity, and performance.
• Automate the infrastructure supporting the data pipeline as code and deployments by improving CI/CD pipelines. Monitor, troubleshoot, and improve the data platform to maintain stability and optimal performance.
• Diplomatically partnering with engineering, product, and data teams to innovate and enable business critical applications, tools, and data intelligence at scale.
• Collaborating with product managers, developers, and data engineers to empower and evolve the culture of data driven decision making.
• Designing, developing, and improving self-service user experience and tools.

Basic Qualifications 

• Experience working on and/or a demonstrable understanding of messaging/queuing systems or stream processing systems.
• A strong understanding and experience with topics related to platform scale, security, availability, deployment and operation
• 3-5 years of experience designing, building, or supporting high performance distributed systems.
• 5+ years of experience building software in preferably Scala or Java.
• Solid understanding in designing and building web-based APIs
• 3+ years of experience working with tools supporting streaming pipelines using Kafka, Akka (plus), Spark Streaming (plus).
• Working knowledge of the Go programming language (plus).

Additional Qualifications 

Experience writing unit tests, performing code reviews, and leading/participating in design discussions about architecture, data shape, and business logic.

Benefits
We offer a competitive salary, stock options, a comprehensive benefits package, including health and dental insurance, unlimited PTO, parental leave, tuition reimbursements, and much more!

SecurityScorecard is committed to Equal Employment Opportunity and embraces diversity. We believe that our team is strengthened through hiring and retaining employees with diverse backgrounds, skill sets, ideas, and perspectives. We make hiring decisions based upon merit and do not discriminate based on race, color, religion, national origin, sex or gender (including pregnancy) gender identity or expression (including transgender status), sexual orientation, age, marital, veteran, disability status or any other protected category in accordance with applicable law. 

We also consider qualified applicants regardless of criminal histories, in accordance with applicable law. We are committed to providing reasonable accommodations for qualified individuals with disabilities in our job application procedures. If you need assistance or an accommodation due to a disability, please contact [email protected].

Any information you submit to SecurityScorecard as part of your application will be processed in accordance with the Company’s privacy policy and applicable law. 

SecurityScorecard does not accept unsolicited resumes from employment agencies.