Mitchell Park Domes Hacksgiving (1st Place)

Problem Statement: The Mitchell Park Domes are a Milwaukee landmark that showcases a variety of plant species from around the world. The Domes wanted a software solution that would increase revenue by enhancing the visitor experience through partnerships, engagement, and accessibility. The challenge was to create a solution that would address these goals while also being user-friendly and easy to implement.

Solution: My team created a mobile application using React Native and Expo that leverages Bluetooth Low Energy (BLE) beacons to deliver location-based information and experiences to visitors. The app includes features such as Dome Detectives—an interactive scavenger hunt that encourages exploration and learning about plants and exhibits. It also includes Botanical Tales, audio stories that provide historical context about plants and exhibits, paced by the user's location via the BLE beacons. A partnership feature, Sip & Seek, allows visitors to purchase drinks from the Domes café and receive an audio tour related to the plant ingredients used in the beverages. The app also includes a chat feature that lets visitors ask questions and receive answers from an AI-powered chatbot. For accessibility, the app offers text-to-speech, adjustable font sizes, and support for 10 languages.

Skills Used:

  • React Native
  • React
  • Expo
  • Mobile Development
  • TypeScript
  • Node.js
  • JavaScript
  • C
  • C++
  • ESP32
  • BLE
  • OpenAI API
  • Machine Learning
  • Artificial Intelligence
  • GitHub
  • Localization
  • Agile Development
Source Code

Development Process

Hackathon Kickoff

Step image 1

We started the process by researching the problem space and brainstorming ideas. We decided to focus on creating a mobile application that would enhance the visitor experience through location-based information and experiences.

Initial Development

Step image 1

We got right to work and developed the mobile application using extreme programming methods. UX work was done in parallel with backend development. We used GitHub for version control and collaboration.

Breakfast Break

Step image 1

We took a quick breakfast break to refuel before heading to the Domes for testing.

Testing at the Domes

We went to the Domes to test our prototype of the Dome Detective feature. We established that the Vision Model and LLM were not prone to hallucinations and that the experience was engaging for users.

Dinner #2

Step image 1

After testing at the Domes, we took another dinner break to recharge before the final development push.

Final Development Push

After testing we made final adjustments and improvements to the app based on our findings. We focused on polishing the user experience and ensuring that all features were working correctly.

Presentation and Awards

Step image 1

We presented our project to the judges and audience. Our team was awarded 1st place for our innovative solution which focused on revenue building strategies and recognized the future of the Domes.