Senior Data Engineer
Crunchbase
About Crunchbase
Crunchbase is a predictive solution that provides intelligence on private companies, powered by the unique combination of live private company data, AI, and market activity from over 80 million users. We predict private market movements that matter to help investors, dealmakers, and analysts make the right decisions.
We are committed to fostering a positive, diverse, and inclusive culture by hiring for potential and embracing individuals with diverse perspectives, backgrounds, experiences, and skill sets. We value transparency and openness, believing that an inclusive environment strengthens our teams and enhances our products.
Crunchbase has a remote-first approach, and is open to hiring in residents of these states: California, Colorado, Illinois, Florida, Georgia, Massachusetts, Nevada, New Jersey, New York, North Carolina, Oregon, Pennsylvania, South Carolina, Texas, Virginia, Washington, and Maine.
Our inclusive remote-first culture, competitive pay, and employee wellness benefits set us apart!
About the Role:
As a Senior Data Engineer, you will be responsible for architecting and implementing robust data solutions to support the growing needs of our organization. You will work collaboratively with cross-functional teams to design and maintain data pipelines, optimize data storage and retrieval, and contribute to the overall success of our data-driven initiatives.
What You'll Do:
Data Architecture and Design: Design and implement scalable and efficient data solutions. Collaborate with stakeholders to understand data requirements and translate them into effective solutions.
Data Pipeline Development: Design, build, and optimize data pipelines for both batch and real-time processing. Ensure the seamless flow of data across systems, maintaining high standards for data quality and reliability.
Data Modeling and Optimization: Develop and maintain data models that align with business needs and support analytics, generative AI, and ML workloads. Optimize data storage, processing, and retrieval for maximum efficiency and performance.
Collaboration and Communication: Work closely with data scientists, analysts, and other stakeholders to understand their needs and provide data engineering support. Communicate complex technical concepts to non-technical team members effectively.
Performance Monitoring and Troubleshooting: Implement monitoring solutions to proactively identify and address performance issues. Troubleshoot and resolve data-related problems in a timely manner.
Technology Evaluation and Adoption: Stay abreast of industry trends and evaluate new tools and technologies to enhance our data capabilities. Make recommendations for technology adoption based on the organization's goals and objectives.
Performs other related duties as assigned.
What We're Looking For:
4+ years of experience in data engineering with a focus on building scalable data solutions.
Proficiency in Python.
Experience with streaming data systems (e.g.: Kafka) and with using databases such as Postgres, Elasticsearch and Redis.
Strong experience with data pipelines, ETL processes, and data warehousing.
Strong background in developing end-to-end solutions in a production environment.
Strong experience with data modeling, ETL processes, and data warehousing.
Familiarity with containerization technologies (Docker, Kubernetes).
Experience with CI/CD tools and practices. Experience with Codex or other agentic/AI-assisted development tools is a plus.
Experience with cloud platforms (e.g., AWS, Azure, GCP, Snowflake) is a plus.
Excellent problem-solving skills and a proactive approach to addressing challenges.
Strong communication and interpersonal skills.
Demonstrated curiosity and comfort using AI tools to enhance productivity and creativity.
Ability to identify when and how to use AI responsibly while maintaining data privacy and accuracy.
Compensation Package:
The salary range is $180,000 - $200,000. We also offer equity in the form of stock options on top of that as the total compensation package.
What Crunchbase Offers:
At Crunchbase, we’re building a culture where talented people can grow, innovate, and make an impact. We invest in our team so everyone has the support, tools, and trust to do meaningful work and thrive — personally and professionally.
Here’s what you can expect:
Competitive compensation and equity — rewarding you for your contributions and ownership mindset
Remote-first flexibility — work primarily from home within our list of approved states, with opportunities for in-person collaboration
Comprehensive health benefits for you and your family, including medical, dental, and vision coverage (PPO, HDHP, and HMO options)
Continuous learning support through generous reimbursement for professional development and skills growth
401(k) and Roth plans with an annual financial adviser check-in to help you plan your future
Wellness resources — including a monthly stipend to support physical and mental health
Work-from-home enablement — internet stipend and home office setup allowance
Charitable giving match through our Town Hall awards and community impact initiatives
A mission-driven, transparent team of creative thinkers and builders passionate about helping companies connect and grow
At Crunchbase, we value team members who are passionate and enthusiastic about what we're building here. We believe there is no "perfect" candidate, and want to encourage applying even if all the requirements listed aren’t met. If you're passionate about Crunchbase and looking to learn and grow, then we look forward to reviewing your application!
Crunchbase does not discriminate on the basis of race, creed, color, ethnicity, national origin, religion, sex, sexual orientation, gender expression, age, height, weight, veteran status, military obligations, or marital status. We will consider for employment qualified applicants with arrest and conviction records. Every day our team is honored to work with entrepreneurs and innovators from every corner of the globe, and we aim to build a team that reflects the diversity of our customers. Each individual at Crunchbase brings their own perspectives, work experiences, lifestyles, and cultures with them, and we believe that a more diverse team creates more innovative products, provides a better service to its customers, and helps us all grow and learn as individuals.
#LI-JM1
