Senior Azure Databricks Engineer

Build the Future with AspenView Technology Partners

At AspenView, we are passionate about transforming the way organizations approach technology. We specialize in creating high-performing, nearshore IT teams to help North American clients innovate faster and more efficiently. As we continue to grow, we’re looking for exceptional people to join our team and help drive impactful change across industries.

Why Join AspenView?

At AspenView, we’re more than a nearshore IT partner—we’re a people-first, purpose-driven company that believes great culture drives great outcomes. We’re passionate about connecting talent and technology to deliver measurable value for clients—and meaningful career paths for our people.

Here’s what you can expect:

  • Competitive base
  • Comprehensive benefits and wellness support
  • Flexible work model: hybrid, remote, or in-office
  • Real growth opportunities and leadership visibility
  • Inclusive, respectful culture that blends U.S. innovation with Colombian heart
  • A company that listens, invests in you, and celebrates wins together

About the role

We are seeking a seasoned Senior Azure Databricks Engineer to architect and optimize data infrastructure on Azure's managed Databricks platform. With a focus on the Latin American IT talent market, where expertise in cloud-native big data solutions is rapidly growing, this role requires deep knowledge of Azure Databricks for scalable data processing, integrated with Airtable for collaborative data management and Superblocks for custom app development. The position emphasizes designing resilient systems to support analytics, AI/ML workflows, and business intelligence in a dynamic, multicultural environment.

What you will do:

  • Design and deploy scalable data pipelines and ETL processes using Azure Databricks, leveraging Azure services like ADLS, Synapse, and Key Vault for integration.
  • Optimize Azure Databricks workspaces, clusters, and jobs for performance, cost, and security, including Delta Lake, Unity Catalog, and Azure-specific features like AAD integration.
  • Build and maintain data models in Airtable, ensuring seamless API connections with Azure Databricks for real-time data syncing and automation.
  • Develop internal tools, dashboards, and workflows in Superblocks, integrating with Azure Databricks and Airtable to enhance operational efficiency.
  • Collaborate with cross-functional teams across Latin America and beyond to gather requirements, troubleshoot issues, and implement data governance best practices.
  • Mentor junior engineers, conduct code reviews, and contribute to documentation in a fast-paced, agile setting.
  • Monitor Azure resource usage, perform root-cause analysis, and recommend architectural enhancements for high-availability data environments.
  • Ensure compliance with regional data regulations (e.g., LGPD in Brazil, data sovereignty in Mexico) while leveraging Azure's global compliance tools.

What you bring:

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 5+ years in data engineering, with 3+ years specializing in Azure Databricks (including Spark, SQL, MLflow, and Azure integrations).
  • Strong coding skills in Python, Scala, or SQL, with experience in Azure cloud services (e.g., Azure Functions, Logic Apps).
  • Familiarity with big data ecosystems like Kafka, Hadoop, or Azure Event Hubs.
  • Excellent problem-solving abilities and experience working in diverse, remote teams common in Latin America's IT sector.

Nice if you have:

  • Azure Databricks Certified Data Engineer or Azure Data Engineer Associate certification.
  • Experience with CI/CD tools (e.g., Azure DevOps, GitHub Actions) and IaC (Terraform, ARM templates).
  • Knowledge of data visualization (e.g., Power BI) and ML operations in Azure Databricks.


Equal Opportunity Employer:

AspenView is proud to be an equal opportunity employer. We believe in creating an environment where all employees feel welcome, valued, and empowered to succeed. We celebrate diversity and strive to build a culture of inclusion where all individuals, regardless of their race, color, gender, gender identity or expression, sexual orientation, disability, age, or any other characteristic, can thrive. We encourage applicants from all walks of life to join our team and make a lasting impact.

Technology

Colombia

Argentina

Partilhar em:

Termos de serviço.PrivacidadeCookiesDesenvolvido pela Rippling