Do you want to apply for this freelance job vacancy?
Yes No

Senior Data Architect

Remote Our client is seeking hands-on support for a project in the Healthcare space. They are building a solution that can receive, normalize, and match data from several sources and be translated into a flexible data model. There are several immediate challenges, including: · Dealing with both streaming and batch data sources · Flexibility of ingestion processes to handle new sources · Management of a large and growing ruleset for classification and normalization · Performance is an overarching concern They have a team of 300 engineers working offshore. However, hands-on architectural leadership, guidance, and coaching are needed to guide the solution and team decisions, specifically in the areas of Azure tooling: Databricks, Service Bus, Blobs, and Medallion architecture. Duration and Hours: This initial engagement is for 2-3 weeks, with a cap of 60 hours as a way to test the fit. Beyond that, extension/expansion of hours is possible, potentially through the end of the year. Location: The position is remote, however the client would love the option for some in-person meetings. Must be willing and able to occasionally travel to NYC area for in-person meetings. Responsibilities (note - not all of these woudl apply to the initial three week trial phase): • Design intermediate and canonical data models • Create initial skeleton architecture & code examples • Mentor team and review detailed designs and code in application areas: o Defining data sources o Creating ingestion jobs and transforming into meta-model o Cleansing, mapping, and processing o Validate against rules (~50k rules at ingest) o Capture exceptions to queues for manual intervention and possible new rules o Transform and send data out to other systems • Share best practices for care & feedback of system • Be hands-on with code where needed to accelerate delivery • Create a Costing model of steady-state operating costs • Train the team on system and eventually hand off to New York City employees Must have extensive experience in: • Azure Service Bus • Azure Functions • Azure Blobs • Azure Databricks • Medallion Architecture • NRules.net

Keyword: SQL

Price: $90.0