Mandarin Snap app for iPhone and iPad

Mandarin Snap is an innovative app designed to make learning Mandarin Chinese an engaging and interactive experience. Utilizing the powerful ResNet50 model from CoreML by Apple, this app brings the latest advancements in machine learning to language education, ensuring a seamless and enriching experience for users of all ages.

Key Features

1. Object Detection with ResNet50

Mandarin Snap harnesses the capabilities of the ResNet50 model to accurately detect objects captured through the camera. This sophisticated neural network is trained to recognize a wide array of items, providing instant and precise identification.

2. Interactive Learning Modes

Challenge Mode
Users are prompted to find and capture specific objects, turning language learning into a fun and competitive game. Points and achievements are awarded for successful detections, encouraging continuous engagement.

Freestyle Mode
Also known as Alternate Mode, this mode allows users to freely explore and detect objects without the pressure of scoring or achievements, making it ideal for relaxed learning sessions.

3. Achievements and Badges

To motivate users, Mandarin Snap includes a variety of badges based on object detection and learning milestones. Each badge is thoughtfully designed, using SF Symbols for clear and intuitive representation.

User Experience

Mandarin Snap is designed with a user-friendly interface that ensures smooth navigation and accessibility. The app opens with a camera view, inviting users to embark on their learning journey instantly. After capturing an object, a detailed view displays detection results, providing users with options to save and learn from the identified items.

The app also features categorized data, covering a wide range of everyday items such as household objects, fruits, animals, and more. This categorization helps users systematically expand their vocabulary in different domains, making the learning process organized and comprehensive.