Staff Data Engineer

Role Description

We are seeking a Staff Software Engineer with expertise in data engineering. In this role, you will manage the entire data engineering lifecycle, which includes:

• Ingesting data from IoT devices
• Transforming and aggregating that data
• Presenting it through backend APIs for both external and internal products

Your work will guide the technical direction of key applications, such as Grid Services and the Sunrun Customer Application. Additionally, you will take a lead role in transforming our data systems into self-healing, reliable, and proactive solutions. On this team, you will develop the data infrastructure and pipelines necessary to ingest and process IoT data from over 1 million solar and storage systems. This data is utilized across our company to ensure accurate billing, maintain system uptime, performance analyses, and provide valuable insights for our customers.

• Help establish development and architectural standards within the team, promoting technical excellence and best practices.
• Work closely with Product Management, DevOps, and other team members to develop applications that are easily testable and perform well under diverse network conditions.
• Ensure consumers have access to the data they need for informed decision-making, focusing on data availability and reliability.
• Champion the adherence to best-practice development methodologies throughout the software development process.
• Build and maintain streaming and batch data pipelines to efficiently process and manage data.
• Design and code scalable and secure algorithms, data structures, and software components.
• Maintain clear and comprehensive documentation for code, systems, and processes.
• Lead design and code reviews to ensure high-quality code and knowledge sharing within the team.
• Facilitate automated testing to enable rapid innovation and ensure the stability of applications.
• Mentor and help build skills across the team through standards setting, code reviews, and pair programming.
• Optimize production applications to maximize efficiency and performance.
• Develop ongoing metrics, analysis, and dashboards to guide important decisions and monitor system performance.

Qualifications

• A Bachelor’s or Master’s degree in Computer Science or a related field is preferred.
• A minimum of 7 years of hands-on experience in developing enterprise applications with Java, Python, and Javascript.
• Extensive experience working with large-scale, high-performance data processing systems, including batch and streaming.
• Strong leadership skills with the ability to mentor and guide team members.
• Extensive experience with AWS cloud platform; some familiarity with GCP cloud platform is a plus.
• Proficiency in both relational and NoSQL databases.
• Familiarity with various cloud services and serverless architectures.
• Proven experience in developing microservices and Lambdas using JavaScript/TypeScript.
• Prior experience working in complex enterprise environments and developing complex programs.
• Strong expertise in REST API architecture and development.
• A focus on automation, including CI/CD practices and test automation.
• Experience with Agile/SCRUM software development methodologies.
• Strong understanding of security practices and data protection.

Requirements

• Equipment pick-up from a local branch will be required.
• We will provide advance notice whenever on-site attendance is required.

Benefits

• Health insurance coverage
• Wellbeing program
• Life and disability insurance
• Retirement savings plan
• Paid holidays
• Paid time off (PTO)
• Annual bonus eligibility based on both company and individual performance
• Short- and long-term incentives and program-specific awards