Job description
Data Warehousing Specialists
Job purpose
To design, model and implement corporate data warehousing, programming and configuring warehouse database structures and the procedures that source, transform and load data into them, and to support warehouse users, so that corporate data is held in a structure that is accurate, documented and efficient to query.
Skills
- Deep technical knowledge of data warehouse architecture and database design — warehouse and data mart structures, sourcing, extraction, transformation and loading models, metadata frameworks, stored procedures and middleware — with programming in current languages, system and data analysis technique, design principles for precise technical models, applied mathematics, and the written English for functional and technical documentation. Bachelor's degree is the norm, with a small remainder entering through associate's degrees or post-secondary certificates, together with several years of related experience and on-the-job training.
- Works to customer requirements gathered and clarified in discussion, providing or coordinating troubleshooting support for warehouse users and explaining the structure and meaning of warehouse data to those who query it. Gives technical consultation and advice, reviews colleagues' designs, code, test plans and documentation, and contributes to team relationships.
- Technical problem-solving of substance: designing warehouse systems that balance optimisation of data access against batch loading and resource utilisation, mapping data between source systems, warehouses and data marts, developing extraction procedures from administration, billing and claims systems, and diagnosing faults reported by users. Selects the methods and criteria by which designs are evaluated, trading performance against cost and maintainability; solutions are designed rather than drawn from precedent.
- Plans and sequences warehouse development from process model through build to unit and integration testing, and sets the standards that later work is held to. Tasks, priorities and goals are largely self-determined against agreed delivery dates and time pressure.
- Work is carried out seated at a desk using development and database tools. No manual handling demands.
Responsibilities
- No line management. Coordinates and leads others in accomplishing work activities, and reviews the designs, code, test plans and documentation produced by colleagues.
- Holds no budget and commits no spend. Design decisions determine how efficiently storage, processing and batch load capacity are consumed, so the choices made carry a cost consequence borne elsewhere.
- Custodian of the data warehouse platform and its tooling, which the postholder designs, implements and operates. Ordinary care of a workstation and development environment.
- Owns the corporate data warehouse and its contents: warehouse and data mart database structures, the process models for sourcing, loading, transformation and extraction, and the mappings between source systems such as administration, billing and claims and the warehouse. Sets the standards for the organisation, structure and nomenclature of data architectures, models and databases, and creates the metadata processes, entity relationship diagrams and process flow documentation describing them; the business rules implemented through stored procedures and middleware come from customer requirements. Verifies the structure, accuracy and quality of warehouse data, since every report drawn from it inherits any defect.
Effort required
- Prolonged, exacting concentration on data structures, code and mappings, where a single error in a transformation propagates into everything downstream. Combines detailed build and test work with design judgement, alongside a steady volume of contact by e-mail, telephone and face-to-face discussion with users and colleagues, and decisions affecting company results taken under time pressure.
- Personal accountability for the technical soundness of designs that others depend on, and for troubleshooting support when warehouse problems are reported. Parts of the work are repetitive. No exposure to distress, hostility or conflict is evidenced.
- Predominantly seated indoor work at a screen, with repetitive keyboard and mouse motions. No lifting or exertion.
Working conditions
- Indoor, environmentally controlled office work without hazard, noise or protective equipment. Contact is with the immediate work group and the warehouse users supported, in person, by telephone and by e-mail. Psychosocial demand comes from accountability for data accuracy and from delivery deadlines in a competitive commercial setting rather than from any physical or emotional exposure.
- Works a regular established schedule; almost half of incumbents work beyond a standard week, but no shift, rota or out-of-hours pattern is evidenced. Determines own tasks, priorities and goals with considerable freedom to make decisions inside agreed requirements and the standards the role itself sets, and is accountable for the quality of what is built.