Courtesy of Adafruit
Guide by Lady Ada
The idea behind the Adafruit BrainCraft HAT is that you’d be able to “craft brains” for Machine Learning on the EDGE, with Microcontrollers & Microcomputers. On ASK AN ENGINEER, our founder & engineer chatted with Pete Warden, the technical lead of the mobile, embedded TensorFlow Group on Google’s Brain team about what would be ideal for a board like this.
And here’s what we designed! The BrainCraft HAT has a 240×240 TFT IPS display for inference output, slots for a camera connector cable for imaging projects, a 5 way joystick and button for UI input, left and right microphones, stereo headphone out, a stereo 1 Watt speaker out, three RGB DotStar LEDs, two 3 pin STEMMA connectors on PWM pins so they can drive NeoPixels or servos, and Grove/STEMMA/Qwiic I2C port. This will let people build a wide range of audio/video AI projects while also allowing easy plug-in of sensors and robotics!
A controllable mini fan attaches to the bottom and can be used to keep your Pi cool while doing intense AI inference calculations. Most importantly, there’s an On/Off switch that will completely disable the audio codec, so that when it's off, there’s no way it's listening to you.
The STEMMA QT port means you can attach heat image sensors like the Panasonic Grid-EYE or MLX90640. Heat-Sensitive cameras can be used as a person detector, even in the dark! An external accelerometer can be attached for gesture or vibration sensing such as machinery/industrial predictive maintenance projects.
The display is a 1.54" wide-angle TFT LCD.
Buttons and Joystick
These pins have a 10K pullup to 3.3V so when the button is pressed or the joystick is moved/pressed, you will read a LOW voltage on these pins.
STEMMA QT Connector
Three fully color RGB addressable LEDs can provide feedback or a light show. Uses DotStar protocol (not NeoPixel) so any microcomputer can easily control the lights.
Before you start, you'll need some parts to make your BrainCraft HAT run! At a minimum you will need:
Raspberry Pi Computer
A working Raspberry Pi (Pi 4+ needed for vision projects, any Pi for audio-only projects)
And an SD card. It can be blank or come with software on it.
For Vision projects
You'll also want a Raspberry Pi camera, a long cable (optional) and camera case (optional).
For Audio Projects
You'll want at least a set of headphones or plug-in speakers!
Raspberry Pi Setup
OK now you have all your parts in order, it's time to get your Raspberry Pi computer set up with the HAT or Bonnet.
Step 1 - Burn SD Card
Use Etcher or the Raspberry Pi Imager to burn the latest Raspbian Lite to an SD card (you can use full, but we won't be using the desktop software and it takes up a bunch of room.
Step 2 - Configure log-in access
You'll need to be able to log into your Pi, either enable SSH access (and use and Ethernet cable), use a USB to serial cable, or connect a monitor and keyboard. Basically, get it so you can log in.
We have a quickstart guide here and here that you can follow, or there's dozens of online guides. it is assumed by the next step you are able to log in and type commands in - ideally from a desktop computer, so you can copy and paste in some of the very long commands!
Step 3 - Log in & Enable Internet
Once you've logged in, enable WiFi (if you have built in WiFi) with sudo raspi-config so you can ssh in.
Enable SSH as well if you haven't yet, also via sudo raspi-config
After you're done, reboot, and verify you can log into your Pi and that it has internet access by running ping -c 3 raspberrypi.org and seeing successful responses.
Step 4 - Update/Upgrade
Now that you are logged in, perform an update/update:
sudo apt update
sudo apt-get update
sudo apt-get upgrade
sudo apt-get install -y python3-pip
sudo pip3 install --upgrade setuptools
OK you've now got a nice, clean, connected, and up-to-date Pi!
Blinka is our CircuitPython library compatibility layer. It allows many of the libraries that were written for CircuitPython to run on CPython for Linux. To learn more about Blinka, you can check out our CircuitPython on Linux and Raspberry Pi guide.
We put together a script to easily make sure your Pi is correctly configured and install Blinka. It requires just a few commands to run. Most of it is installing the dependencies.
sudo pip3 install --upgrade adafruit-python-shell
sudo python3 raspi-blinka.py
When it asks you if you want to reboot, choose yes.
Finally, once it reboots, there are just a couple CircuitPython libraries to install for the BrainCraft HAT or Voice Bonnet.
The DotStar library is for controlling the 3 on-board DotStar LEDs and the Motor library is for testing out the GPIO pins.
pip3 install --upgrade adafruit-circuitpython-dotstar adafruit-circuitpython-motor adafruit-circuitpython-bmp280
That's it for Blinka and CircuitPython libraries.
Start by making sure you've installed I2C support, see the previous page (Blinka Setup) on how to do it!
Install Voicecard software
Make sure you've got the BrainCraft HAT or Voice Bonnet installed, and I2C support installed as well!
When you run sudo i2cdetect -y 1
you should see an entry under 1A, indicating the hardware sees the audio card. The number may also appear as UU if you already installed software.
At the command line run:
At the end you should see something like this:
and on reboot run
sudo aplay -l
To list all sound cards, you should see it at the bottom.
If your card number differs from the above image, take note of your number.
You can use alsamixer to adjust the volume, don't forget to select the card with F6.
A gain of about 60% is plenty loud!
Make sure the Audio On/Off switch is set to ON!
With either headphones plugged into the headphone jack or a speaker attached to the speaker port, run.
you will hear white noise coming out of the speakers/headphones!
If you don't hear anything, make sure you have the audio on/off switch set!
There are two microphones, and now we can test that they work. This test is best done with headphones, not using the speaker port, because it can cause a painful feedback effect if the speakers are next to the mics!
sudo arecord -f cd -Dhw:1 | aplay -Dhw:1
If your sound card ID is not #1, then replace the number in both of the -Dhw: parameters with your actual number.
Then either gently rub each microphone or speak to hear yourself echoed!
Control-C to quit when done
Your audio subsystem is now completely tested!
Fan Service Setup
We have a really simple fan service that will control the onboard fan. The reason we have it set up as a service instead of keeping the fan on all the time is so that it doesn't drain too much power from the Pi during the initial power on.
The fan service basically controls turning GPIO 4 on at startup, which is what the fan is connected to. Installing the fan service is really simple and we have a script for doing that.
To install, just type in the following commands.
sudo pip3 install --upgrade adafruit-python-shell
sudo python3 adafruit_fanservice.py
A message letting you know what the script does will come up.
When it asks you if you want to continue, select Yes.
That's it. You should hear the fan start up right after the script finishes running.
Display Module Install
There's two ways you can use the 1.54" 240x240 display on the BrainCraft HAT. For machine learning purposes, the advanced method is the way to go, so that's what we'll be covering in this guide.
Be aware that you can only choose to do one way at a time. If you choose the advanced way, it will install the kernel driver, which will prevent you from doing it the easy way without uninstalling the driver first.
The easy way is to use 'pure Python 3' and Pillow library to draw to the display from within Python. This is great for showing text, stats, images etc that you design yourself. If you want to do that, the BrainCraft HAT has a pretty close layout to the Adafruit 1.3" Color TFT Bonnet including the same type of display and a joystick, though the pinouts are slightly different. If you choose this option, You can skip this page and view the Python Setup page for instruction for that display.
The advanced way is to install a kernel module to add support for the TFT display that will make the console appear on the display. This is cute because you can have any program print text or draw to the framebuffer (or, say, with pygame) and Linux will take care of displaying it for you. If you don't need the console or direct framebuffer access, please consider using the 'pure Python' technique instead as it is not as delicate.
If you plan on using the Pi Camera for vision projects, you will need to go with the advanced route!
Installing The 1.54" Kernel Module
We have tried to make this as easy as possible for you by providing a script that takes care of everything. There's only a couple of dependencies needed. To get everything setup, just run the following at the terminal:
sudo pip3 install --upgrade adafruit-python-shell click==7.0
sudo apt-get install -y git
git clone https://github.com/adafruit/Raspberry-Pi-Installer-Scripts.git
sudo python3 adafruit-pitft.py --display=st7789_240x240 --rotation=180 --install-type=fbcp
When you get asked to reboot, reboot!
That's it! You will now have the BrainCraft HAT with a console display on it.
Now that you have everything set up, it's time to do an initial test with the camera. This should display what the camera sees on the display.
raspistill -t 0
At this point, you should have just about everything already set up.
Besides the display, audio, and fan, this board has quite a few other useful features on it that can be controlled through Python. We'll go through those and how to control them in Python.
Joystick and Button
The 5-way Joystick and button just use simple digitalio and each uses a separate GPIO, so they're really simple to control. Here's a little script that will setup the GPIOs, Create Internal Pullups, and then print out the value to the terminal.
from digitalio import DigitalInOut, Direction, Pull
BUTTON_PIN = board.D17
JOYDOWN_PIN = board.D27
JOYLEFT_PIN = board.D22
JOYUP_PIN = board.D23
JOYRIGHT_PIN = board.D24
JOYSELECT_PIN = board.D16
buttons = [BUTTON_PIN, JOYUP_PIN, JOYDOWN_PIN,
JOYLEFT_PIN, JOYRIGHT_PIN, JOYSELECT_PIN]
for i,pin in enumerate(buttons):
buttons[i] = DigitalInOut(pin)
buttons[i].direction = Direction.INPUT
buttons[i].pull = Pull.UP
button, joyup, joydown, joyleft, joyright, joyselect = buttons
if not button.value:
if not joyup.value:
if not joydown.value:
if not joyleft.value:
if not joyright.value:
if not joyselect.value:
Go ahead and save the above code onto your Pi as button_test.py and run it with the following command:
Now try moving the joystick and press the button and you should see it print out what you're pressing.
The 3 DotStar LEDS can be controlled with the DotStar CircuitPython Library. Here's a little script that will setup the DotStar LEDs and then color cycle them.
DOTSTAR_DATA = board.D5
DOTSTAR_CLOCK = board.D6
dots = adafruit_dotstar.DotStar(DOTSTAR_CLOCK, DOTSTAR_DATA, 3, brightness=0.2)
# Input a value 0 to 255 to get a color value.
# The colours are a transition r - g - b - back to r.
if pos < 0 or pos > 255:
return (0, 0, 0)
if pos < 85:
return (255 - pos * 3, pos * 3, 0)
if pos < 170:
pos -= 85
return (0, 255 - pos * 3, pos * 3)
pos -= 170
return (pos * 3, 0, 255 - pos * 3)
for j in range(255):
for i in range(3):
rc_index = (i * 256 // 3) + j * 5
dots[i] = wheel(rc_index & 255)
Go ahead and save the above code onto your Pi as dotstar_test.py and run it with the following command:
The DotStar LEDs should start color-cycling in a rainbow.
GPIO JST connectors
GPIOs 12 and 13 are accessible with the JST connectors on either side of the BrainCraft HAT.
For this script, we'll just need one part that isn't included with the BrainCraft HAT:
from adafruit_motor import servo
SERVO_PIN = board.D12
pwm = pulseio.PWMOut(SERVO_PIN, frequency=50)
servo = servo.Servo(pwm, min_pulse=750, max_pulse=2250)
for angle in range(0, 180, 5): # 0 - 180 degrees, 5 degrees at a time.
servo.angle = angle
for angle in range(180, 0, -5): # 180 - 0 degrees, 5 degrees at a time.
servo.angle = angle
Go ahead and save the above code onto your Pi as servo_test.py and run it with the following command:
The servo should start sweeping back and forth in 5 degree increments.
For the Stemma QT port, you can use any of our 50+ sensors, but we're going to use a script that demonstrates using the BMP280 because it's so simple.
For this script, we'll just need a BMP280 and a Stemma QT cable:
"""Simpletest Example that shows how to get temperature,
pressure, and altitude readings from a BMP280"""
# import digitalio # For use with SPI
# Create library object using our Bus I2C port
i2c = busio.I2C(board.SCL, board.SDA)
bmp280 = adafruit_bmp280.Adafruit_BMP280_I2C(i2c)
# OR create library object using our Bus SPI port
# spi = busio.SPI(board.SCK, board.MOSI, board.MISO)
# bmp_cs = digitalio.DigitalInOut(board.D10)
# bmp280 = adafruit_bmp280.Adafruit_BMP280_SPI(spi, bmp_cs)
# change this to match the location's pressure (hPa) at sea level
bmp280.sea_level_pressure = 1013.25
print("\nTemperature: %0.1f C" % bmp280.temperature)
print("Pressure: %0.1f hPa" % bmp280.pressure)
print("Altitude = %0.2f meters" % bmp280.altitude)
Go ahead and save the above code onto your Pi as bmp280_simpletest.py and run it with the following command:
The terminal should start printing out the detected measurements.