Azure Databricks Architect

Company: Cognizant Technology Solutions
Location: Boston
Posted on: October 23, 2024

Job Description:

Title: Azure Databricks Architect (Onsite) Cognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process outsourcing services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.). Cognizant is a member of the NASDAQ-100, the S&P 500, the Forbes Global 1000, and the Fortune 500 and we are among the top performing and fastest growing companies in the world. Practice - AIA - Artificial Intelligence and Analytics About AI & Analytics: Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their consumers need. Within AI & Analytics, we work to design the future - a future in which trial-and-error business decisions have been replaced by informed choices and data-supported strategies. By applying AI and data science, we help leading companies to prototype, refine, validate, and scale their AI and analytics products and delivery models. Cognizant's AIA practice takes insights that are buried in data and provides businesses a clear way to transform how they source, interpret, and consume their information. Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources into informative, meaningful intelligence. Location: Boston, MA (Onsite) Job Summary We are seeking a Sr. Architect with 10 to 14 years of experience to join our dynamic team. The ideal candidate will have extensive experience in Databricks Workspace Admin Databricks CLI Databricks Unity Catalog Kafka Azure Monitor Azure Data Lake Store Azure Key Vault Azure DevOps Azure Event Hub Python Databricks SQL Databricks Workflows and PySpark. This is a hybrid role with day shifts and no travel required. Responsibilities

• Lead the design and implementation of scalable data architectures using Databricks and Azure technologies.
• Oversee the administration of Databricks Workspace and ensure optimal performance.
• Provide expertise in Databricks CLI and Unity Catalog for efficient data management.
• Implement and manage Kafka for real-time data streaming solutions.
• Utilize Azure Monitor to track and optimize system performance.
• Manage data storage solutions using Azure Data Lake Store.
• Ensure data security and compliance with Azure Key Vault.
• Coordinate with development teams using Azure DevOps for seamless CI/CD pipelines.
• Integrate and manage event-driven architectures using Azure Event Hub.
• Develop and maintain data processing workflows using Python and PySpark.
• Create and optimize SQL queries within Databricks SQL for data analysis.
• Automate data workflows and pipelines using Databricks Workflows.
• Collaborate with cross-functional teams to deliver high-quality data solutions.
• Provide technical guidance and mentorship to junior team members.
• Drive continuous improvement initiatives to enhance data architecture and processes.
• Ensure alignment of data solutions with business objectives and goals.
• Contribute to the companys mission by delivering impactful data solutions that drive business success. Qualifications
  • Possess a minimum of 10 years of experience in data architecture and related technologies.
  • Demonstrate expertise in Databricks Workspace Admin Databricks CLI and Databricks Unity Catalog.
  • Have hands-on experience with Kafka for real-time data streaming.
  • Show proficiency in using Azure Monitor Azure Data Lake Store and Azure Key Vault.
  • Exhibit strong skills in Azure DevOps for CI/CD pipeline management.
  • Be experienced in Azure Event Hub for event-driven architectures.
  • Have advanced knowledge of Python and PySpark for data processing.
  • Be skilled in writing and optimizing SQL queries within Databricks SQL.
  • Demonstrate ability to automate workflows using Databricks Workflows.
  • Possess excellent problem-solving and analytical skills.
  • Show strong communication and collaboration abilities.
  • Be committed to continuous learning and staying updated with industry trends.
  • Have a proven track record of delivering successful data solutions. Certifications Required
    • Databricks Certified Professional Data Engineer Microsoft Certified: Azure Solutions Architect Expert Salary and Other Compensation: The annual salary for this position is between $160,000 - $ 170,000 depending on experience and other qualifications of the successful candidate. This position is also eligible for Cognizant's discretionary annual incentive program, based on performance and subject to the terms of Cognizant's applicable plans. Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:
      • Medical/Dental/Vision/Life Insurance
      • Paid holidays plus Paid Time Off
      • 401(k) plan and contributions
      • Long-term/Short-term Disability
      • Paid Parental Leave
      • Employee Stock Purchase Plan Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law. Cognizant is an Equal Opportunity Employer M/F/D/V. Cognizant is committed to ensuring that all current and prospective associates are afforded equal opportunities and treatment and a work environment free of harassment. Cognizant is recognized as a Military Friendly Employer and is a coalition member of the Veteran Jobs Mission. Our Cognizant Veterans Network Assists Veterans in building and growing a career at Cognizant that allows them to leverage the leadership, loyalty, integrity, and commitment to excellence instilled in them through participation in military service. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Keywords: Cognizant Technology Solutions, New Bedford , Azure Databricks Architect, Professions , Boston, Massachusetts