Close

Building the Tingle

A project log for Hacking Wearables for Mental Health and More

Presenting the "Tingle" wearable for compulsive behaviors and a hacked fitness tracker wearable device prototyping platform.

curt-whiteCurt White 10/19/2018 at 19:270 Comments

1: Unboxing and Dissembling the N68 Fitness Tracker

This is the fitness tracker used as a foundation for current Tingle prototypes. It can be had for $30-40 from China ( Link1 , Link2 , Link3 , Link4 ) or $63 on Amazon Prime if you are in a hurry. The primary reason I chose the N68 it its cast metal enclosure and magnetic power adapter. The appearance of Tingle prototypes is extremely important. We will be asking parents of vulnerable children to put these devices on their child's wrist. A finished, off the shelf appearance is important to gaining their trust. In addition, these prototypes are handled by decision makers at CMI and potential funders, both of whom appreciate a polished product. The N68 as a color OLED screen, KX126 accelerometer, 8MB GigaDevice FLASH memory IC, vibration motor and simple LED/Photo-receptor heart rate sensor. 

NOTE: As I'm documenting build steps I will be showing pictures of four devices being fabricated. Building these prototypes one at a time is very tedious. Also, multiple prototypes means you get to see multiple examples of each build step.

The strap and glass cover are both removed. The cover is attached with glue. I use a hobby knife to cut around the edges of the cover, thereby loosening in.

A small screw driver is used to pry up the cover.

Here you can see the cover removed and placed upside down. The bottom section of the cover has a contact for the touch sensor affixed, and the top has an extension of the Bluetooth antenna. There is also a PCB antenna embedded in the circuit board itself so this isn't strictly necessary.

Here are all four N68s with covers removed. 

The electronics have been removed from the enclosure. The battery and heart rate (HR) sensor are lightly glued to the bottom of the enclosure but can easily be lifted out with a small prying tool.

Here you can see the green LED for the HR sensor lit up. The HR sensor is not currently used in the Tingle prototype but this is just a matter of programming, these sensor is readily available for use. During a clinical study we hope to monitor HR during detected compulsive behavior events. The HR sensor might even offer additional filtering of false positive detections since elevated HR is correlated with the anxiety that underpins compulsive behaviors.

N68 Fitness Tracker Components

Closeup of N68 PCB ICs. External flash and HR sensor are not currently used in the Tingle but could be implements by simply writing additional code.


2: Removing the OLED Display

The Tingle does not use the N68's display. It uses up power and space which I would rather devote to sensors and sensor data processing. The display is easily removed with a soldering iron by gently pulling on the display as the soldering iron is played across the display contact area.

With the display removed.

Display removed from all four prototypes.


3: Wiring Up the N68 PCB

The N68 PCB will have to be connected to the sensor cap, an external programmer and power supply. Conveniently, there are factory test pads which I can solder wires to.

Fluxing the PCB test pads I will be soldering wires to.

Pre-soldering the test pads to make soldering easier + stronger.

Fluxing and pre-soldering the ends of the wires I will be using.

My soldering setup. I have a pretty nasty hand tremor so everything has to be setup as if I'm going to do it one handed. That way I can brace my right hand with my left while also resting my right hand on the above leather sand bag.

All the wires have been soldered on. 

Red: 3V

Black: GND

Top Blue: SDA for I2C

Top Green: SCL for I2C

Bottom Blue: DIO for SWD programming

Bottom Green: SCK for SWD programming

Yellow: Button on sensor cap

Brown: Serial UART TX or Misc. GPIO for external adapter.

This last purple wire is kind of tricky. It recycles a GPIO that was used by the display but which is not easily accessed with a test pad. The puple wire controls the LED on the sensor cap.

Once all the wires are soldered to the board I solder header pins to the other ends this is necessary for testing, something that is extremely important to do at multiple stages since there is so much hand soldering in play.

Finished with wiring up the N68 boards! (for now at least).


4: 3D Printed Sensor Cap Fabrication

The sensor cap is where the magic happens. This is where the Tingle really sets itself apart from other attempts and gesture recognition feedback for compulsive disorders. Tingle really leverages the strengths of 3D printing. The angles and placement of Tingle's sensors are crucial to its function on an individual basis. In addition, all the sensor placements have to be exactly the same across prototypes, both to make the machine learning models work and also for research data collection. 3D printing allows for complete control over sensor position, plus the ability to rapidly iterate and test various sensor configurations. The above is the Tingle sensor cap model in Blender, the software I used to create it. The sensor cap model can be found in the Tingle project Github repository. 

The inside of the cap has been modeled so that all the various components will slide into place exactly where they are supposed to go.

1a: MLX90615 Thermal sensor 1

1b: MLX90615 Thermal sensor 2

1c: MLX90615 Thermal sensor 3

1d: MLX90615 Thermal sensor 4

2: VL6180 distance sensor

3: LED

4: Button

5: Power switch

Sensor cap being printed on a Zortrax M200 3D printer in black ABS plastic.

This is what the sensor cap looks like fresh off the printer.

The inside and outside of the printed caps are going to be rough. I use sandpaper, hobby knife and scrapers to make them accurate representations of the original 3D model they need to match.

I finish the sensor cap with acetone and an ABS/acetone slurry. The truth is that 3D printed objects don't look that great, or at least not to parents, donors and administrators. There are many different techniques that can be used to finish ABS plastic with acetone. I've tried quite a few and this works best for me. Above you can see granulated black ABS plastic (the same plastic used to print the caps) about to be mixed with acetone. 

Here you can see the ABS/acetone slurry, a mostly finished cap and some brushes I was using.

Here are the finished caps. I did a whole bunch at once.

The inside of the caps have been cleaned up to match the original 3D model.

The MLX90615 sensors are fragile so I have recessed them inside the enclosure with a protective bezel protruding out and around their field of view. I use a Dremel grinding tool and sandpaper to clean up the bezels.

Finished sensor cap plastic ready to have sensors mounted.


5: Testing Components

There are many stages at which testing is necessary. Testing saves a huge amount of time in the long run. Above you can see all the components layed out for testing and inspection.


6: Grinding Out Metal Enclosure Bottom

The Tingle needs to interface with an external programmer on a regular basis. The Tingle's Nordic nRF52832 SoC is programmed over a two wire (clock and data) SWD interface. In addition, ground and power from the nRF52 must be exposed to the programmer. An additional GPIO (P3) is exposed for use for debugging (data logging) over serial UART. All five connections are made avalable using a 1mm pitch header pin socket recessed inside the enclosure.  To make extra room (and keep the connector flush with the PCB) I grind and outlet into the cast metal alloy enclosure bottom. Here you can see the connector flush against the enclosure. 

This is what the enclosure looks like after using a Dremel cut-off wheel to grind out room for the connector.


7: Prepping the VL6180 distance sensor

Above top is a small VL6180 time-of-flight (Lidar) sensor breakout as it looks when first purchased. I use this sensor on an I2C bus along with all the thermal sensors. The two pull up resistors on this breakout cover the I2C needs of the thermal sensors since they are all on the same I2C bus. Above bottom is the same model breakout with all extraneous material ground off with a Dremel cut-off wheel to save space inside the Tingle sensor cap. 

All four sensor breakouts with wires which I will solder to them. The wire tips have been fluxed and pre-soldered.

Two wires are soldered each to GND, V+, SDA and SCL. One set of wires will be connected to the N68 PCB and the other set of wires will be connected to the MLX90615 thermal sensors. 

fully prepped VL6180 sensor breakouts.


8: Adding an Antenna

A little foil antenna was glued to the glass cap of the N68 fitness tracker. Since we removed it, we should replace it. I say "should" instead of "must" because the PCB tracings act as an antenna no matter what. Adding an antenna as I show will increase Bluetooth range though. The white blob on the bottom left corner of the PCB above is a contact for the antenna. 

I solder a 3cm SOLID copper wire to the antenna contact. It is very important that this wire be solid metal if it is to act as an antenna.

Antenna wires have been soldered onto all four N68 PCBs.


9: Battery Connector Wires for Switch

Being able to cut off power to prototypes is essential because it is an easy way to reboot them. The easiest way to do this is a switch between the battery and the device.  I desolder the ground (black) wire from the battery to the PCB.

An extension wire is soldered to the battery ground (black) wire for eventual connection to a switch.

Another wire is soldered to the PCB where the battery was previously connected.

Here you can see battery connection extension wires on all four N68 PCBs


10: Prepping the Tingle Sensor Cap Buttons

Your typical momentary push buttons.

I cut off extra pins and press the two remaining against the body of the button.

I solder one wire to each button. This one yellow wire will be connected to the matching yellow wire soldered to the N68 PCB.


11: Prepping the LED breakouts

These little SMD LED breakouts from Tiny Circuits are handy. I could have accomplished the same effect many ways but this is convenient and durable.

I solder one wire to the negative connector on the breakout. This purple wire will be connected to the matching purple wire on the PCB.

Here you can see all four LED breakouts with wires attached.


12: Prepping the SMD Switch

These switches are really small. They are connected to the N68 battery.

Wires are soldered to each of the two pins. These wires will be connected to the black wires previously soldered to the battery and battery/PCB connection point.


13: Testing the N68 PCB before Attaching Header Pin Socket Connector

If you are building prototypes for yourself and they stop working, no big deal. If you hand off a prototype to a colleague, or even worse a tester/patient, and it stops working, it really sucks. Hand building prototypes the way that I am demonstrating is an inherently unstable process. There are many many ways in which things can go wrong and chances are that one of them will. Obsessively testing throughout the build process is the only way to ensure that this process produces a durable prototype. I constantly inspect everything that I do under a jewelers loupe. I wiggle each wire to make sure the solder connection is good. I drop everything from a height of two feet every now and then for a little stress testing. I also breadboard all the components multiple times throughout the build process. Here I am connecting the SWD programmer to the N68 PCB to make sure everything is working the way it should.


14: Adding a Header Pin Socket Connector

All the wires we are soldering to the connector at trimmed back.

I put header pins in the socket to keep out epoxy and make sure the heat from the soldering iron doesn't warp the inside of the socket.

As always, all solder connection points are fluxed and pre-soldered.

Soldering the socket to the PCB wires.

I start on the outside with my brown Serial TX wire.

All five wires soldered to the header pin socket

The header pin socket connector is epoxied to the PCB to stabilize it.

The connector has been soldered to the PCB. It should extend 1.5mm over the edge of the PCB.

A little perspective...

For this step multiple examples are nice. You have to fold the wires against the PCB to get everything fitting nicely.

All four PCBs with connector sockets attached.


15: Prepping the MLX90615 Thermal Sensors

Each thermal sensor has to be individually programmed before use. I cover this in the "Programming the Tingle" project log. Here the leads of the sensor have been trimmed and bent back. Leaving 2mm works well for me.

I just dunk the sensor leads in flux.

You have to be careful when soldering the leads. The body of the sensor is connected to ground, and there is only 0.3mm of space between each lead and the body where the lead meets the body. If any solder gets in the dark area you can see at the base of each lead above it will short that connection to ground.

The MLX90615 sensor elements are exposed and very fragile. If you were to smear peanut butter on them by accident, the whole device sensor cap would be toast - they are very difficult to replace. I use an ear thermometer cover to protect them. I hate this part of the build, but it works well and I have yet to find a better way of doing things. The ear thermometer covers are extremely thin but surprisingly strong.

Double sided tape. Bet your weren't expecting to see that. I use double sided tape to attach a small piece of ear thermometer cover to the top of the thermal sensor.

Here is where things get a little wild. The hole in the tap must exactly match the size of the MLX90615 sensor element. Too big and there wont be enough tape left on the sensor to keep it attached. Too small and it will cover up the sensor itself. I spread a peace of tape across a mini hack saw (could have used any number of things) and carefully poke holes in it with a soldering iron. I poke a whole bunch of holes for each sensor because it takes a couple tries to get a hole the right size.

I switch from my primary iron tip (left) to a really long tip I only use for poking holes in plastic.

Poking holes in double sided tape.

Thermal sensor mounted on hole that is just the right size.

There are two different versions of the MLX90615 thermal sensor: one with a large sensing element and one with a small sensing element. I'm still trying to figure out which is best so I alternate at the moment. The small ones are definitely easier when it comes to this stage of the build.

Close up of thermal sensor mounted on tape hole.

Trimming the tape from the top of the sensor.

We are left with a tiny, tiny ring of double sided tape.

Even more tiny on the MLX90615 version with a larger sensing element.

I only use the tip of the ear thermometer cover.

I wrap the tip of the ear thermometer cover over a pencil eraser to flatten it and make sure there are no folds. Then I press the MLX90615 thermal sensor with double sided tap ring against the ear thermometer cover material. 

Here you can see more clearly. 

The excess ear thermometer cover material must be removed.

Here is the fully prepped thermal sensor ready for mounting in the 3D printed sensor cap. If any peanut butter gets on it you can clean it with a Q-tip dipped in rubbing alcohol. This also makes the Tingle more water resistant.


16: Mounting the Thermal Sensors

The thermal sensors are pressed into the designated area of the 3D printed sensor cap. It is extremely important that the right thermal sensor go in the right place. Refer to the diagram in step 4 which shows where each sensor goes. Each thermal sensor has its own unique address programmed into it (see "Programming the Tingle"). Sensor I2C addresses are 2A (sensor 1), 2B (sensor 2), 2C (sensor 3), and 2D (sensor 4).

All thermal sensors mounted. A small amount of epoxy is used to fit them in place. I epoxy them one at a time to make sure the placement is perfect.


17: Test Components Before Sensor Cap Assembly

Here you can see all our prepped components.

Another angle. All components and connections should be inspected and stress tested. Depending on how much testing has been done up until this point in may be prudent to breadboard everything and live test with production firmware. 

Here I am bread boarding a VL6180 distance sensor to test it. I have an extra N68 fitness tracker wired up to a breadboard just for testing components.


18: Mounting the VL6180 in the Sensor Cap

The VL6180 breakout fits into the sensor cap as shown. The actual sensor itself fits into the rectangular hole in the cap. The breakout is epoxied into the cap. Care is taken to ensure that excess epoxy does not get into the sensor itself.

VL6180 breakouts mounted in all four prototype sensor caps.

Another view.


19: Mounting the LED Breakout in the Sensor Cap

The LED breakout is mounted and epoxied into the sensor cap as shown.

Another view. I find that having the wire which conects to the PCB towards the center works best. The other end of the breakout will be connected to V+ (power), which I daisy chain across the thermal sensors.

Another view.


20: Mount Push Button in Sensor Cap

This is a little tricky because the button will have a lot of force applied to it which means it has to be really firmly attached to the cap - but the button is also really easy to clog with epoxy. I usually epoxy the button to the enclosure in two stages: first with a small amount of fresh epoxy and second with a larger amount of epoxy that has hardened to the point of being a little sludgy.

All components mounted in the sensor cap - bottom view.

All components mounted in the sensor cap - top view.

Aren't they beautiful? Take a deep breath because the next step is a doozy. 


21: Sensor Cap Internal Connections

The VL6180 distance sensor and MLX90615 thermal sensors all run on the same I2C bus. This means that all the SDA, SCL, GND and V+ connections on all these sensors have to be connected with wires.

Green = SCL, Blue = SDA, Black = GND, Red = V+

Each thermal sensor has a little metal nub sticking out out of it. This is used to determine which pin is which. Above is from the MLX90615 data sheet.

Connect SCL from the VL6180 to SCL on the front thermal sensor.

Connect GND from the VL6180 to GND on the front thermal sensor. Then connect GND from the first thermal sensor to the empty lead on the button.

Another view

Wire the rest of the connections between the VL6180 and the front thermal sensor.

Another view. Each time I make a connection, I solder two wires, not one. I trim the wire I am going to make a connection with, strip the end, strip another wire and twist the ends together. Then I flux and solder the tips together. Because everything is pre-soldered, I don't have to apply any additional solder when I attach the wire-pair to the sensor lead (or button or LED breakout). All I do is press the tip of the wire pair against a sensor lead (or whatever) and quickly apply just enough heat to fuse together the solder which is already on the wires and sensors I am trying to connect.

Another view.

The VL6180, front thermal sensor and left thermal sensor (orientations as they appear on a completed prototype pointed away from a user with sensor cap pointed up) have been connected. In the picture I am holding a wire pare from V+ against the "+" side of the LED breakout for soldering. 

V+ from the left thermal sensor has been connected to the LED breakout with a wire pair.

Another view.

Connecting the left thermal sensor to the center thermal sensor.

Another view.

Another view.

All connections complete.

All connections complete for all four prototypes.

Another view. Its all downhill from here - assuming nothing got screwed up.


22: Testing the Completed Sensor Cap

If I'm going to make a mistake anywhere, its going to be the internal connections on the sensor cap. At this point bread-boarding the entire prototype is as easy as connecting the wired up N68 PCB to the sensor cap leads (the second set of wires from the VL6180). I test everything with the production firmware I use to run these prototypes in the wild (hand off to test users).   


23: Mount Battery Switch in Sensor Cap

The mini SMD switch is epoxied into place in the sensor cap. Care must be taken so that the epoxy doesn't clog the switch. This step is so easy compared to wiring up the sensor cap sensors that I consider the cap complete before I even mount the switch - as long as it tests out.


24: Coat Everything With Nail Polish

Nail polish is great. It acts as an insulator most importantly. It also strengthens everything. Unlike epoxy it is easy to remove. Once everything in mounted in the sensor cap I coat it all with clear nail polish. I also coat the N68 PCB.

Everything nice and shiny with a top coat of nail polish.


25: Hard-wiring Battery Charger Connections

The N68 fitness tracker has a lovely magnetized battery charging outlet mounted in the metal enclosure bottom. You can see the magnets to either side of the pins above. Those two pins are spring loaded and press against the main PCB. This is a design bug in the N68 fitness tracker itself. This fitness tracker will often stop working because the above pins do not press against the PCB hard enough, or because oxidation blocks an electrical connection. I get around this by hard wiring the charger outlet to the PCB contacts.

Here I've chopped off the tops of the pins with wire snips.

I solder wires to the pins.

Another view.

The wires from the battery charger outlet are trimmed and soldered to the PCB.

All four PCBs and metal enclosure bottoms with charger outlets soldered to PCBs.

I bend the wires to the sides even before I solder so that the PCB will fold cleanly into the enclosure.


26: Reinforcing the PCB and Programming Connector

I apply epoxy to all solder points on the PCB to strengthen it.

I apply additional epoxy around the programming connector to strengthen it.

All four prototypes with fortified PCBs.


27: Final Coat of Nail Polish 

I add another coat of nail polish to the inside of the sensor cap and the top of the PCB. When these are joined to each other, pressure will be applied to connections in a fashion which is not always predictable. Taking precautions insures that there will be no issues when the sensor cap and PCB and sandwiched together.


28: Connecting the Sensor Cap to the PCB

Wires on sensor cap and PCB are trimmed.

Another view.

Wire tips are striped, fluxed and pre-soldered.

Wires are soldered together. Everything should be color coded at this point.

Another view.

All four sensor caps and all four PCBs connected.

Another view.

Another view.

Connection points are reinforced with epoxy - you can see it beading a little where the wires are soldered together.

All four prototypes with epoxy reinforced connections.


29: Testing Before Closing Cap

Each prototype should be tested again at this point.


30: Closing Sensor Cap

The 3D printed sensor cap has been modeled to fit perfectly into the metal part of the enclosure. This works really well, I've never had any issues. 

I sand the areas that will fit against metal (the sanded plastic is a little lighter in color that the rest of the plastic in the above picture.

The wires are coiled as they are tucked under the cap.  The cap is close slowly and great care is taken to ensure no wires get pinched between the sensor cap and metal enclosure. A small dab of epoxy on the sanded area will keep the sensor cap firmly attached. I usually wait on the final epoxy until after additional testing.

All four prototypes that are functionally complete.

The PPG heart rate sensors should fit neatly into the window in the bottom of the enclosure. Double check before permanently closing the device.


31: Power Switch Detailing With Acetone Plastic Wielding

The 3D model includes power on/off detailing in relief on either side of the switch. This allows for the addition of colored plastic. No kind of paint will work for this, its plastic wielding or nothing at all.

Here I have cleaned out the detailing with a tiny screw driver.

I use green and red ABS plastic shaved from 3D printer filament. 

Green ABS plastic ready to be mixed with acetone.

I dab a little green plastic/acetone slurry into the sensor cap detailing. The acetone acts as a solvent on the sensor cap ABS plastic, permanently welding the green ABS plastic to the sensor cap's black ABS plastic.

Red ABS plastic about to be mixed with acetone.

Prototypes with greed and red ABS plastic wielded onto the sensor cap.

Excess green and red plastic are sliced away, leaving only what fit into the relief detailing - exactly as designed.

Closeup of power switch detailing. These little touches may seem unnecessary but they make a big difference in how the devices are received.


32: Completed Prototypes

Completed prototypes are attached to a variety of straps. People tend to like having control over there personal appearance so Its nice to give people choices as far as straps are concerned. 

So normally you would only wear one on your wrist... but four looks really cool!

Ready to be handed off to a test user (after some additional testing). 

Discussions