Sr Data Engineer

Other Jobs To Apply

<strong>Overview<br><br></strong>Baker Tilly is a leading advisory, tax and assurance firm, providing clients with a genuine coast-to-coast and global advantage in major regions of the U.S. and in many of the world’s leading financial centers – New York, London, San Francisco, Los Angeles, Chicago and Boston. Baker Tilly Advisory Group, LP and Baker Tilly US, LLP (Baker Tilly) provide professional services through an alternative practice structure in accordance with the AICPA Code of Professional Conduct and applicable laws, regulations and professional standards. Baker Tilly US, LLP is a licensed independent CPA firm that provides attest services to its clients. Baker Tilly Advisory Group, LP and its subsidiary entities provide tax and business advisory services to their clients. Baker Tilly Advisory Group, LP and its subsidiary entities are not licensed CPA firms.<br><br>Baker Tilly Advisory Group, LP and Baker Tilly US, LLP, trading as Baker Tilly, are independent members of Baker Tilly International, a worldwide network of independent accounting and business advisory firms in 141 territories, with 43,000 professionals and a combined worldwide revenue of $5.2 billion. Visit bakertilly.com or join the conversation on LinkedIn, Facebook and Instagram.<br><br>Please discuss the work location status with your Baker Tilly talent acquisition professional to understand the requirements for an opportunity you are exploring.<br><br><em>Baker Tilly is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status, gender identity, sexual orientation, or any other legally protected basis, in accordance with applicable federal, state or local law.<br><br></em><em>Any unsolicited resumes submitted through our website or to Baker Tilly Advisory Group, LP, employee e-mail accounts are considered property of Baker Tilly Advisory Group, LP, and are not subject to payment of agency fees. In order to be an authorized recruitment agency ("search firm") for Baker Tilly Advisory Group, LP, there must be a formal written agreement in place and the agency must be invited, by Baker Tilly's Talent Attraction team, to submit candidates for review via our applicant tracking system.<br><br></em><strong>Job Description<br><br></strong>Baker Tilly is seeking a <strong>Sr Data Engineer</strong> to join the founding team of the firm's AI Product Group (APG). This hands-on engineering role is responsible for building scalable, secure, and reliable data infrastructure that powers the firm's AI applications and intelligent agents. The position focuses on two critical areas: developing a governed data foundation that transforms enterprise information and client documents into high-quality, traceable data products, and building the knowledge layer that enables AI agents to retrieve, interpret, and use information accurately. This includes developing production data pipelines, implementing data models and governance controls, and supporting advanced capabilities such as knowledge graphs, enterprise search, and retrieval.<br><br>As an early member of the AI Product Group, this individual will collaborate closely with data platform leadership, AI engineers, enterprise architects, business practitioners, and globally distributed technical teams to deliver production-ready data solutions. The role emphasizes strong data engineering fundamentals, hands-on development, data quality, and evaluation-driven engineering practices. The ideal candidate brings demonstrated experience building and operating modern lakehouse pipelines, strong Python and SQL skills, and the ability to develop reliable, maintainable solutions in a fast-paced environment. Prior experience with AI, machine learning, or knowledge graphs is not required; success in this role depends on sound engineering judgment, analytical thinking, and the ability to learn and apply emerging technologies.<br><br><strong>Key Responsibilities<br><br></strong><ul><li>Design and Build Data Pipelines: Develop, implement, and maintain scalable batch and incremental data pipelines that transform structured and unstructured information into clean, validated, business-ready datasets within a modern lakehouse environment.</li><li>Develop and Maintain Lakehouse Architecture: Build and optimize data processing and transformation layers using modern lakehouse principles, including medallion architecture, data modeling, and integration of enterprise and legacy data sources.</li><li>Ensure Data Quality, Lineage, and Provenance: Implement automated validation, reconciliation, lineage tracking, and metadata management to ensure data accuracy, consistency, traceability, and reliability throughout the data lifecycle.</li><li>Build Data Models and Identity Resolution Capabilities: Develop scalable data models, data contracts, and entity-resolution processes that establish consistent client, engagement, and document identities across enterprise data sources.</li><li>Implement Data Governance and Access Controls: Support data cataloging, classification, permissions, and access management to ensure sensitive information is appropriately governed and accessible only to authorized users and AI agents.</li><li>Develop Knowledge Graph and Retrieval Capabilities: Build and maintain knowledge graph structures, data relationships, search indexes, and retrieval pipelines that enable AI applications to access relevant, accurate, and properly governed enterprise information.</li><li>Support AI Data Readiness and Continuous Learning: Develop pipelines that capture AI agent activity, practitioner feedback, reviews, and corrections to support ground-truth datasets, AI evaluation, and ongoing improvements in data and retrieval quality.</li><li>Drive Evaluation-Based Data Engineering: Establish measurable quality standards, testing frameworks, benchmarks, and validation processes to assess data extraction, retrieval effectiveness, and grounding accuracy.</li><li>Maintain Data Freshness and Reliability: Implement incremental processing, change data capture, versioning, and monitoring capabilities to ensure data products, knowledge graphs, and search indexes remain accurate and current as source systems evolve.</li><li>Own Production Delivery and Operational Support: Deploy, monitor, troubleshoot, and maintain production data pipelines, applying strong engineering practices, automated testing, code reviews, and operational documentation.</li><li>Support Knowledge Transfer and Technical Ownership: Collaborate with external engineering partners to transition data solutions into internally owned, documented, and maintainable production environments, including the development of reusable code, tests, and runbooks.</li><li>Collaborate Across Global and Cross-Functional Teams: Partner with AI Engineering, Platform & Production Engineering, enterprise data teams, subject matter experts, and engineering teams in India to align technical solutions with enterprise standards and business objectives.</li><li>Support Strategic Initiatives: Participate in special projects and perform other duties as assigned to advance the firm's AI and data platform capabilities.<br><br></li></ul><strong>Qualifications<br><br></strong><ul><li>Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred.</li><li>3 years of hands-on data engineering or software engineering experience, including demonstrated success developing, deploying, and maintaining production data pipelines.</li><li>Required experience independently building and operating production pipelines on a modern lakehouse platform, with demonstrated ownership of data processing, transformation, and operational reliability.</li><li>Required experience implementing data quality, lineage, or data contracts within production pipelines, including automated testing, reconciliation, validation, or traceability practices.</li><li>Strong proficiency in Python and SQL, with demonstrated ability to develop, optimize, test, and maintain production-quality data engineering solutions.</li><li>Strong understanding of data modeling principles, including the ability to design scalable, maintainable data structures that accommodate evolving business requirements and source systems.</li><li>Experience designing and developing batch and incremental data pipelines for structured and unstructured enterprise data.</li><li>Strong software engineering fundamentals, including version control, automated testing, code reviews, debugging, and development of reliable, repeatable data processing workflows.</li><li>Demonstrated ability to validate technical solutions through measurable outcomes, including automated tests, benchmarks, experiments, performance metrics, or comparative evaluations.</li><li>Experience with modern lakehouse technologies such as Databricks, Apache Spark, Delta Lake, or medallion architecture strongly preferred.</li><li>Experience with cloud-based data platforms, preferably Microsoft Azure, and associated data storage, processing, and integration services preferred.</li><li>Familiarity with enterprise data governance capabilities, including data catalogs, classification, access controls, lineage, and technologies such as Unity Catalog or comparable solutions preferred.</li><li>Experience with knowledge graphs, graph databases, graph data modeling, vector search, hybrid search, or retrieval-based applications preferred.</li><li>Familiarity with unstructured data processing, document extraction, metadata management, content chunking, or search indexing preferred.</li><li>Experience with entity resolution, master data management, change data capture, or incremental data processing preferred.</li><li>Understanding of data provenance, traceability, and governance requirements within complex enterprise or regulated environments.</li><li>Strong analytical thinking, technical judgment, and problem-solving skills, with the ability to independently evaluate trade-offs, troubleshoot complex issues, and develop scalable solutions.</li><li>Excellent written and verbal communication skills, including the ability to document technical solutions, explain complex concepts, and collaborate effectively with technical and nontechnical stakeholders.</li><li>Demonstrated ability to work with business subject matter experts, engineering teams, and globally distributed stakeholders to translate requirements into reliable data solutions.</li><li>Ability to manage competing priorities, adapt quickly to evolving requirements, and deliver high-quality solutions in a fast-paced, collaborative environment.</li><li>Experience using AI-assisted and agentic development tools to improve engineering productivity, or a strong willingness to incorporate these technologies into daily development practices.</li><li>Prior experience with AI, machine learning, LLM systems, or knowledge graphs is not required; demonstrated engineering fundamentals and the ability to learn emerging technologies are essential.</li><li>No professional certifications or licenses required.<br><br></li></ul><em>The pay rate range for this job position are listed below. Actual compensation is influenced by a variety of relevant factors including but not limited to applicant’s skills, prior experience, qualifications, degrees, professional certifications, work arrangements and geographic location. Baker Tilly offers a comprehensive compensation and benefits package to eligible employees.<br><br></em><em>The national pay rate range is $185,000 –$230,000<br><br></em><em>In California: pay rate range is $185,000 –$230,000<br><br></em>

Back to blog

Other Jobs To Apply

Growth Enterprise Account Executive

Remote Book Fair Growth Consultant

Content Strategist – reputed company Kindle Publishing Support – No Degree Needed

Lead Product & Lifecycle Growth Marketer

Remote Book Fair Growth Consultant

Live Nation Entertainment is hiring: Insomniac - Media Admin, New Media in Calab

Content Strategist – reputed company Kindle Publishing Support – No Degree Needed

Lead Product & Lifecycle Growth Marketer

Digital Customer Experience Lead

Live Nation Entertainment is hiring: Insomniac - Media Admin, New Media in Calab

Business Office Associate- Part Time

Digital Customer Experience Lead

Business Office Associate- Part Time

Senior UX Designer - REMOTE (US), User Experience

Senior UX Designer - REMOTE (US), User Experience

Programme Compliance Engineer (Graduates / Placements welcome)

Programme Compliance Engineer (Graduates / Placements welcome)

Product Marketing Director – Managed Business

Routing/Switching Networking Solution Sales (Remote US)

Senior Site Reliability Engineer – CloudVision as a Service

Remote Senior FinTech Solutions Architect - Presales

Application Services Specialized Sales Executive -Digital Sales at Atos SE: 100% Remote (US)

[Remote] Principal, Supply Chain Digital Transformation

LPN / LVN

Remote Inside Sales Executive: Agency Growth & Quotas

Remote Business Systems Manager & Product Owner

Traveling Safety Rep - Dedicated

Founding AgentSpot AE - Enterprise AI Sales

Founding AgentSpot AE - Enterprise AI Sales

Remote Solutions Engineer, Public Sector

Online Data Quality Evaluator - Flexible Schedule (Remote)

Manager, Provider Recruiting – Global

Headspace, Calm or Insight Timer users to provide feedback on new meditation app

Remote Telehealth Registered Dietitian (Part-time)

Revenue Operations Specialist

Supervising Video Editor

Data Enterprise Reporter Job at Gannett in Mc Lean

Senior Food Video Producer — Social & Lifestyle (Hybrid)

Nexstar Media Group Inc. is hiring: Broadcast IT Engineer in Austin

Photographer/Editor

Audacy, Inc. is hiring: Morning Show Co-Host WKSE in Buffalo

Traffic Anchor/Editor

Senior Product Manager (Authentic)

Hyperscale Customer Program Manager 4

Senior Lease Administration Associate and Abstractor at JLL - Jones Lang LaSalle: 100% Remote (Pittsburgh, PA)

Machine Learning Engineer

Customer Service Rep (100% Work From Home)

Director - AI Operations

Maintenance Specialist IV (Electrician)

Remote Senior Manager, Customer Retention & Growth

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...