Is it worth to read in .csv data into InfluxDB?

Last Updated on October 23, 2022 by pg@petergamma.org

  • we tested the possibility to convert Garmin .fit file to .csv by data scientist Max Candocia tool
  • it is probably one of the best options to access sensor data from a Garmin watch
  • but our goal is to have our sensor data in InfuxDB
  • if we import .csv files, we need different InfluxDBs for different .csv files from different devices, since the time stamps are not synchronized
  • is it worth to do this?
  • It is already possible to have the data from Apple Whatch in Home Assistant and InfluxDB synced trough and Android App
  • we are especially interested in calibrated respiration data
  • the Polar Sensor Logger App can stream PPG and R-R peak data to Home Assistant
  • if it works, we can also use the Polar SDK, if we do not want an Android App which is closed source in our path
  • we have on this path all the required data for respiratory rate estimation
  • we have presented respiratory rate estimation in Python on this site
  • in Matlab, there are datasets available to calibrate respiratory rate
  • we do not know, whether these also work with Python, but it is worth test it
  • with this excellent script we can enter data in real-time into InfuxDB:

https://github.com/influxdata/influxdb-client-python/blob/master/examples/iot_sensor.py

  • we can enter all the data we want to InfluxDB in real-time by modifying this example
  • we can eventually use this script also to connect it to the Rest API of the OpenBCI WIFI shield to have OpenBCI data in InfuxDB