Universal system of data acquisition for digital biomarkers.
Neuro Explorer is a system, which goal is the data acquisition for digital biomarkers of neurodegenerative diseases that would aggregate data from various biosensors.
Neuro Explorer is an idea that grown on real needs
Rapid experiment creation
Neuro Explorer is a platform built on top of the Chromium engine. Thus the whole interface is written in the HTML/JavaScript/CSS combination.
Data unified in the time domain
Software logs consist of normalized, millisecond-precise timestamps with additional annotations during experiment events.
Easy to use
Interface is designed with the consumer-centric approach. Friendly for both Researcher and Data Scientists.
Pick what you need
The researcher can conduct every experiment with a chosen number of devices. The current list supports eight sensors: eye tracker (TheEyeTribe, owned by Facebook), EEG (NeuroSky), GSR (ThoughtStream), Leap Motion, Microphone (every audio interface), Face Analysis (based on the video camera), Pulse Oximetry (Contec) and Hand Dynamometer (Vernier).
Connected technologies for insightful outcomes
JSONL data format
Aggregated data are in the form of separate .jsonl files that are processed quickly by, for example, the Pandas library for Python.
OpenFace 2.2 support
Neuro Explorer relies on a state-of-the art tool intended for facial landmark detection.
WebSocket driven
All data aggregated by the software is available in the real-time mode through the local WebSocket server.
Elastic approach
A significant factor of that software is its elasticity. For example, if given Research Organisation does not have an eye-tracker, it still can use this software without any modifications. The researcher can experiment with classical webcam and even register eye movements. For Voice Analysis, most of the standard microphones are supported. Neuro Explorer is automatically detecting supported hardware, and if it is not available, it will not be used. Although more powerful hardware, more accurate results.
How to conduct an experiment?
Pick a research field
The current version allows conducting four different experiments.
Pick a set of devices
Right now, we support eight sensors, including eye tracker, EEG and Face Analysis.
Register data
For full concentration, Neuro Explorer provides two separate windows, one for the researcher and one for the patient.
Find answers to your questions below
What is the idea?
Neuro Explorer is an idea that grown on real needs. During our studies on Parkinson's and Alzheimer's diseases, we noticed that there is a niche for software that would aggregate multimodal data from different sensor streams for digital biomarker modeling. For example, how to evaluate a hypothesis about subconscious facial emotional responses on a given stimulus in early PD patients and measure brain activity, pulse, GSR, and eye movements simultaneously? Or, how to add disease-specific devices, like dynamometer or hand tracker, and keep data unified? How to re-use a set of sensors that we already have in our Academia and keep the budget tight? Thus, we created a software platform that has three main goals: to ensure rapid experiment creation, aggregate data unified in time and keep it in a form understandable for the end-user - the non-IT researcher.
What is Neuro Explorer?
Neuro Explorer is a system, which goal is the data acquisition for digital biomarkers of neurodegenerative diseases that would aggregate data from various biosensors. This project combines assumptions of the research software, which multiple researchers used for facial emotional responses and eye movements measurement in the context of Parkinson's and Alzheimer's disease.
What technologies do you support?
Neuro Explorer is a platform built on top of the Chromium engine. Thus the whole interface is written in the HTML/JavaScript/CSS combination. However, the main driver is created in C#.
What sensors can I use?
The researcher can conduct every experiment with a chosen number of devices. The current list supports eight sensors: eye tracker (TheEyeTribe, owned by Facebook), EEG (NeuroSky), GSR (ThoughtStream), Leap Motion, Microphone (every audio interface), Face Analysis (based on the video camera), Pulse Oximetry (Contec) and Hand Dynamometer (Vernier). Data from these sensors are with different frequencies, so the software logs consist of normalized, millisecond-precise timestamps with additional annotations during experiment events.
What experiments can I do?
The current version allows conducting four different experiments. First - "Saccades" allows measuring saccades and antisaccades based on well-tested protocol. Second: "Emotions" displays the stimulus in the form of the video presenting various, spontaneous emotions. Third: "Hands" consists of the tasks related to hand movements and grip strength. Fourth: "Voice" displays slides (currently: in the Polish language) that lead the patient through vocabulary examinations.