Expert Web-Crawling in the Cloud and Energy Environment (m/f) - Bayern / NRW #3900

- Practical knowledge in web-crawling techniques and technologies (e.g., Jsoup, Apache Nutch, Scrapy) using various temporal and geolocation based information
- Software development in Java, Java Script, PHP, HTML/HTML5
- Good knowledge in the field of information extraction, indexing, retrieval (e.g., regular expressions, Apache Solr)
- Familiar with RDBMS design and development (e.g. MySql, PostgreSQL or SqlServer)
- Familiar with Azure Cloud services is a plus

IHRE AUFGABEN

- Design a data model that can manage data from different industry standards for metering, electrical devices and energy - Crawling external web-sources based on a specific information need, parse and extract data, ingest it into a local database
- Database design and development containing a mix of customer, transactional and community feedback relevant information
- Deployment of the data centric framework within a cloud environment
- Implementation of the information search and retrieval module

IHR ANSPRECHPARTNER

Alessia Cosentino
Telefon: +49 221 16020 17
E-Mail: [email protected]