Fully Transparent Data Processing Aimed at Minimizing the Time from Measurement to End User
All MissionOS data is loaded and stored directly on the cloud based platform. A local staging server may be used for data collation as required. MissionOS processing is multi-layered. The final public site will show the data which passes built-in audit filters and manual review. Administrators can see all the data. We have developed very sophisticated tools to deal with imperfect data and avoid spurious warnings and alarms from being generated. All processing steps are completely transparent so that users can compare with manufacturers recommendations.
Management Interface
All data management can be undertaken online and is two tiered. Changes and edits and new data are first published to an intermediate layer where the implication of the change can be viewed and approved before releasing to the general user base. All processing steps are completely transparent and processed data can be saved at each stage so that the implications of each processing layer can be seen and evaluated.
All original files are saved as part of the process. Files modified by the user are also saved in history database. Files upload can be by: Direct upload, Post to FTP, Email
Real Time Data Sources
Real time data sources which are ODBC compliant can be loaded by the MissionOS. If the sources are web addressable ie web databases or ftp sites then the information can be parsed and loaded directly and automatically. If the sources are not web addressable then a staging server is required. This staging server runs a windows application MISSION CONTROL along with schedulers to send information to the web systems for assimilation into the database. The MISSION CONTROL runs systems which manage the extraction only of updated data and send this to web servers in this way limiting the FTP traffic to manageable levels.
Filters, Quarantine and Audit
Filters can be set based on credible magnitude, rate of change (spike detection) and persistence. Data falling outside predefined ranges will be quarantined and will not give rise to alarms and will not appear in the public area. Data can also be quarantined manually. Quarantined data will be presented for action in the audit report and the MissionOS will require data managers to action quarantined data. All filters are agreed with the client before being implemented. Audit — Automated audit reports can be run by MissionOS at regular intervals to identify missing or incorrect information. These audit reports are export to excel and can be reloaded to update the data.
Post Processing
The system provides a number of post-processing stages including: Automatic corrections for benchmark movement Tidal correction of piezometers Bias correction on inclinometers Drift correction on tilt meters Thermal corrections and removal of natural drift Auto revision Correction for changing pipe levels
Review
All data entered into MissionOS goes through a two level system — at administrator level the user can see all the data including data entered by staff for approval. This must be reviewed and approved before release to the public site. The ability to upload and review data in the field improves the quality of data Correct — Incorrect data can be corrected in the system and the system will track the changes in the data with the name of the originator of the change and change date. In addition to simple corrections to typographic errors MissionOS has built in ergonomic feature and functions to address many common sources of error in instrumentation data to ensure minimal delay getting data to end users.
visit : https://www.maxwellgeosystems.com/missionOS/capabilities/dataprocessing
keyword : Transparent data processing
