Controlled imports
Choose the date range and confirm the scope
Back to all work
E-commerce & systems integration
Publisher data sync hub
Publisher reporting data, imported into one fast local system.
The source platform was slow to use for everyday reporting. We built a secure application that imports click, banner and campaign data, then makes it available through searchable local views.
The requirement
The reporting team needed reliable access to data held in an older platform.
Large imports could take time or stop before they finished. The team needed to control the date range, see what the application was doing and work from a complete local copy after the import.
- Import click, banner and campaign data by date range
- Show the user what will be replaced before an import starts
- Keep imported records searchable and ready to export
- Run imports manually or on a daily schedule
- Record failures and make problems easier to diagnose
What we built
One application for importing and reviewing the data.
Users can run an import, search the local records and schedule the next update. These screens show the real application with client data replaced by sample data.
The outcome
The team can import the data once and use it throughout the day.
The reporting views no longer need to query the source platform each time. Manual controls, scheduled jobs and logs make the process easier to run and support.
Searchable records
Clicks, banners and campaigns in local views
Scheduled updates
Daily jobs with a clear last-run time
Useful logs
Failures and retries available for support
Technology
The technology behind the work.
- Next.js
- TypeScript
- MySQL
- Docker
- Live progress
- Scheduled jobs
About this project
- Sector
- Digital publishing
- Services
- Systems integration, data synchronisation and operational reporting
- Project type
- Internal reporting application
Need data from an awkward external system?
Tell us where the data lives and how your team needs to use it. We can build a reliable import and reporting workflow around it.