Automated Applications
When a digital process lends itself to repetition without requiring human input, it may be suitable to run as an entirely automated application. This can be applied in many different areas but the most powerful use is when a task flow can be automated from start to finish.
The application will often begin by collecting large quantities of data, from one or more sources. The data is then cleaned, processed and stored. The next stage is the transformation of the data using statistical analysis techniques which have previously been tested on large quantities of out of sample data.
If the data is static, then collection and processing can be relatively straightforward and often done overnight, but in some applications, the amount of information being received in real-time can be in the order of many thousands of data points per second. All of this can be dealt with using multithreading or multiple concurrent servers.
The final step is producing actionable insights which can be utilized dynamically in real time and the entire process can be automated to repeat every day.
