Data Scientist

The Underwater Threat (UWT) team have a requirement for an SQL database to align with an existing database known as DISAM.

Additionally, migration of data from a Legacy Microsoft Access database to the SQL database is required. This task requires development of the UWT SQL database, with a web-based user interface, storing data on systems of interest to the UWT team. UWT Database to be compatible with the DISAM knowledge store (already maintained by the Threat Evaluation Group). Data will need to be migrated from a Legacy Microsoft Access database, which no longer correctly functions, to the new database. The database will initially be developed for a standalone machine, but requires a process to migrate to the database to the Dstl TS network in the future.

The successful candidate will develop and use data infrastructure for analysis of business and security data. You will have experience of: working with technical and business stakeholders, analysis and presentation; data development life cycle; ETL techniques and tooling; data management experience; very strong SQL skills; application of statistical modelling, trend identification, smoothing and regression; visualisation techniques using appropriate tools (R, SAS, pandas, Matlab, mathematica etc.); and managing automated and manual data workflows - job scheduling, resource management

Day to day activities include: collaborating with business analysts and stakeholders to understand how available data can be used to drive efficiency; working with the user experience team to gain insight into user behaviour; working with representatives from policy to understand how policy decisions are driving behaviour.

Within this role experience is needed with DISAM database & its architecture, Developing SQL databases, Simple user manuals, Developed clear system documentation.

Key tasks required from the database developer are as follows:

Capture the user requirements of the underwater team for the new data store

Implement the requirements in the new SQL database and user interface

Migrate data from the Legacy Microsoft Access database to the new SQL database - included testing to ensure validity of the data migration

Produce a user guide for the database

Produce a system manual which sufficiently documents the architecture of the database as to allow future developers to modify the database (if required)