Job Details
Principal Data Solutions Architect
Full time Position
Oakland, CA
This position is hybrid, working from your remote office and your assigned work location based on business need
Bay Area Minimum: $132,000
Bay Area Maximum: $226,000
-Or-
California Minimum: $125,000
California Maximum: $215,000
* Looking for some with strong architecture for service-oriented Spark based systems and Kafka.
* Must have Palantir Foundry - If you couldn't find candidates with Palantir Foundry you can submit the candidates with Kafka, Spark.
* Keep up-to-date with the Flink and Kafka capabilities of Palantir Foundry releases, features and best practices and recommend changes to improve efficiency, performance and scalability.
* Kafka, Flink, Apache is desired.
* Look for Data Engineer.
* Must have spark, Hadoop.
* Big plus to have Java.
* Nice to have Python.
* Lead technical design and implementation of Flink and Kafka event driven use cases.
* No JAVA coding test but will ask few questions on Java.
* 2 rounds of Interview.
* Min 5 years of exp.
Position Summary:
We are looking for an Expert Technical Lead to be a part of our exciting and growing team. Your primary focus will be to provide technical leadership and mentorship across our Flink and Kafka real-time data platform and product engineering teams. You will lead technical design and implementation of real-time event driven use cases and drive technical feasibility discussions for our products as you collaborate with other technical leaders, product owners and development leads. You will be required to Client the boundaries of our platforms, provide solutions for technical problems and drive discussions within IT and Lines of Business. As a productive member of a motivated group of engineers, product teams, and technical analysts, you will be producing ground-breaking, forward thinking, and revolutionary projects that will modernize critical infrastructure.
Job Responsibilities:
* Lead technical design and implementation of Flink and Kafka event driven use cases.
* Ensure best practices are followed for performance tuning, security, and data governance.
* Build awesome big data products within a fun team where culture is the foundation for success.
* Lead and mentor the development team in a hands-on way.
* Provide technical feasibility assessment while collaborating with Product Owner and Design team to guide features and provide technical know-how.
* Define and address application non-functional requirements, and manage technical debt Debug and optimize complex applications.
* Effectively communicate the vision and architecture to team members Maintain a productive working environment for development teams Be a strong advocate for a culture of quality across the team.
* Collaborate with external teams, especially security, to design, implement and support solutions that are scalable and efficient.
* Build best-in-class real time analytics products with Flink and Kafka.
* Effectively communicate the solution to non-technical stakeholders Follow an agile development methodology.
* Keep up-to-date with the Flink and Kafka capabilities of Palantir Foundry releases, features and best practices and recommend changes to improve efficiency, performance and scalability.
* Advocate for appropriate data modelling techniques to enable agile development and the business use cases, specifically in the integration of event-driven with batch data processing.
Qualifications:
Minimum:
High School or GED-General Educational Development-GED Diplom
5 years' relevant work experience to include experience as a Technical Lead and intermediate to expert level development in Python and Java.
Desired:
BA/BS degree in Computer Science, Engineering, Business or related field or equivalent experience
10 years of experience in IT working in application development and architecture, with 7 years project implementation experience and hands-on experience developing data products
Expert in the solution architecture discipline, processes, concepts, and best practices
Firsthand experience building solutions in Flink and/or Kafka including development of Java and/or Python Flink UDFs.
Exposure to a process improvement discipline (e.g., Six Sigma) used within a technology supported business process implementation
Process design, information modeling and / or system solution architecture development with project or portfolio focus in at least one of the following: Cloud Architecture, Data Management, Security, Microservices, or Infrastructure technologies
Operational support for applications, systems, or infrastructure
Experience providing direction to design and engineering staff
Experience providing direction to one or more architects and technical leads
5 years of experience developing solution architectures for complex data platforms and products
5 years of hands on experience working with multiple technologies and platforms such as integrations with ERP systems (e.g. SAP), Cloud technologies (e.g. AWS) etc.
Demonstrated solid understanding of architecture best practices and enterprise-scale solution development
Possess diversified technical background with Enterprise System Solution mindset
Able to provide individual or project oversight on rapid prototyping/POC efforts and large-scale enterprise wide roll out planning
Experience working with technology and business partners to develop secure and scalable solutions
Experience working as an Agile/Technical Lead in an Agile environment
Experience with developing solutions for data-driven applications
Experience with GIS is a plus
Knowledge of SAP and/or ESRI a plus
Knowledge of Data Vault 2.0 modeling techniques a plus
Excellent communication and collaboration skills and a strong work ethic
Very strong analytical and problem-solving skills
Able to build strong relationships with and influence at the Director level of leadership
Able to build a sense of trust and rapport that creates a comfortable & effective workplace
Able to further community & elevate team performance
Brings a high-energy and passionate outlook to the role and has strong sense of ownership
Department Overview:
Client Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality technology solutions.
This position is hybrid, working from your remote office and your assigned work location based on business need. The assigned work location will be within the Client's Service Territory.
The Data, Analytics & Insights Team within IT is responsible for working collaboratively with the lines of business (e.g., Electric Operations, Gas Operations, etc.) to implement consumer-grade data platforms and products across various user groups (e.g., asset strategists, inspectors, emergency operations, etc.).
This includes, but is not limited to:
Deploying best-in-class / rapid delivery capabilities for data solutions and self-service enablement for highly skilled analysts and data scientists
Simplifying, improving, and standardizing processes to promote data-driven decisions and drive the digital transformation of the utility.
Rapid delivery of back-end solutions for a multitude of applications