Principal Data Architect- Databricks

JOB SUMMARY

The Principal Technical Architect- Databricks at Argano is a critical role that involves providing strategic direction for technical architecture across the organization. This position requires a high level of expertise in designing and implementing complex solutions, as well as mentoring and guiding junior technical architects. This position supports the diverse business needs of complex clients and the implementation of various applications utilizing Argano proprietary tools and methodology. They function as a team leader for mid to large projects and are responsible for managing the technical track on client engagements, defining the technical architecture with a technical solution.

RESPONSIBILITIES

• Technical Architect for complex and large-scale solutions.
• Define and drive the technical strategy for the organization.
• Responsible for assisting in the establishment of an Argano Technical Architecture practice, and the adoption of an architecture and standards methodology.
• Lead and mentor a team of technical architects, providing guidance on complex projects.
• Collaborate with senior leadership to align technical initiatives with business goals.
• Evaluate and adopt new technologies to enhance organizational capabilities.
• Represent the technical architecture function in client meetings and discussions.
• Coordinate and provide leadership in development of project plans, analysis, design, and development of complex mission-critical project implementation.
• Lead and participate in implementations, enhancements, and extending applications.
• Solution best practices to operationally monitor technical interfaces and extensions.
• Collaborate with other departments to ensure alignment of technical strategies.
• Ensure design/solution is strictly maintained and enhancements are documented clearly, approved, and communicated to all client users including C-level executives through extensive version control management.
• Lead client teams in discussions to adopt best practices in implementing and maintaining technical solutions.
• Work with business users to test the entire process after completing development and resolve all issues reported by users.
• Leverage Databricks partner ecosystem tools (e.g., Fivetran, dbt, Coalesce, Alation) to support data integration, transformation, and governance initiatives.

MINIMUM AND/OR PREFERRED QUALIFICATIONS EDUCATION

Bachelor's degree in Computer Science, Information Technology/Systems, Software Engineering or a related field.

EXPERIENCE

• 10-15 years of experience in software development and architecture.
• Proven leadership experience, with a track record of leading successful technical teams.
• Extensive experience in designing and implementing enterprise-level solutions.
• Strong understanding of industry trends and emerging technologies.

CERTIFICATES, LICENSES, REGISTRATIONS

Databricks Engineer Associate or Professional Certification is a strong plus.

SKILL REQUIREMENTS

• Programming: Expertise in Python and SQL, including building scalable ETL pipelines, advanced data transformations, and automation.
• Databricks Expertise: Hands-on experience with Databricks, including managing workspaces, cluster optimization, and advanced features like MLflow and Delta Live Tables.
• Database Management: Expertise in working with various database management systems (DBMS) such as SQL Server, PostgreSQL, Oracle, or others.
• Data Integration: Experience in designing and implementing data integration solutions. Knowledge of ETL (Extract, Transform, Load) processes and tools.
• Data Engineering: Advanced knowledge of cloud-based data platforms (e.g., Azure, AWS, or Google Cloud) and data modeling best practices.
• Big Data Frameworks: Strong understanding of distributed computing frameworks like Apache Spark.
• Visualization Tools: Familiarity with data visualization tools such as Tableau or Power BI.
• Leadership Skills: Experience in mentoring and coaching technical teams, fostering a culture of continuous learning. Comfortable collaborating with other departments to align technical strategies with business goals.
• Architecture Design: Proven experience in defining and designing technical architectures for client engagements. Ability to create comprehensive architectural documentation and diagrams.
• Analytical and Critical Thinking: Strong problem-solving skills to identify and resolve complex technical challenges.
• Client Engagement: Ability to collaborate with clients to understand their technical requirements and challenges. Communicate complex technical concepts to non-technical stakeholders effectively.
• Project Management: Ability to assist in project planning, resource allocation, and timeline management.
• Communication: Possesses excellent communication and interpersonal skills to interact with clients, team members, and other stakeholders.
• Teamwork: Ability to collaborate effectively with cross-functional teams, including developers, engineers, project managers, and other architects.
• Databricks Partner Ecosystem Tools: Familiarity with modern Databricks ecosystem tools such as Fivetran, dbt, Coalesce, and Alation is preferred, but not required.