
IPad Eye-Tracking Reading App (SeeSo SDK + Audio) MVP
- or -
Post a project like this£200(approx. $265)
- Posted:
- Proposals: 12
- Remote
- #4406841
- OPPORTUNITY
- Expired
♛ Most Trusted #1 Team |19+ years of expertise in Website, Mobile Apps, Desktop & Console Games. Wordpress, ReactJS, Shopify, Laravel, Python, React Native, Flutter, Unity, Unreal Engine and AR/VR




♛ TOP Rated ♛ | Mobile App Development | Web Development | React Native | Flutter | ReactJS | NodeJS | AngularJS


11972778506139117672411101892712834211871174120978431150194368182911892228199278311193042





Description
Experience Level: Entry
I’m looking for a developer to build a prototype iPad app that plays different music depending on where the user is reading on the screen. This project combines eye-tracking with an emotionally responsive soundtrack to create a new kind of immersive reading experience.
The app will use the front-facing camera on the iPad to track the user’s gaze and trigger audio changes as they move through a story.
We are creating a new reading experience. As you read a story the soundtrack will change based on where you are in the text.
⸻
Core Features
1. Text Display (Apple Books Style)
• Fullscreen reading layout
• Clean, justified text layout with serif font (similar to Apple Books)
• Black text on white background
• Story text should be either scrollable or paginated
• Display must look like a proper e-book, not a notes app or text editor
2. Gaze-Responsive Music Playback
• The text will be split into paragraphs or blocks, each linked to a unique audio file
• When the user’s gaze dwells on a block for about 1 second:
• Trigger the corresponding audio loop
• Fade out the previous audio (or transition smoothly)
• Begin looping the new track
• If the user looks away or glances elsewhere, the current audio should continue looping
• If they return to a previously played block, audio should not restart
• The result should feel like a dynamic, mood-responsive soundtrack that adapts to the user’s place in the story — not one-to-one word syncing, but a flowing emotional bed that shifts as the narrative progresses
⸻
Flexibility Required
I need to be able to update the content myself. That means:
• I should be able to swap out the story text
• I should be able to change or replace audio files
• I should be able to define which paragraph triggers which audio using a simple config file (JSON, text file, or similar)
This can be done manually by editing files or dragging them into folders. No admin interface is needed — just clear folder structure and documentation so I can maintain it manually.
⸻
Technical Requirements
• Must use the SeeSo SDK by VisualCamp: https://seeso.io
• Target platform: iPad
• You can build in Swift or Unity — whichever tool you’re most comfortable with
• No user accounts, no cloud sync — everything runs locally on the device
• Final version must be distributed via TestFlight for testing
⸻
Deliverables
• iPad app installable via TestFlight
• Source files + clear instructions for editing text/audio/config
• One round of revisions or fixes after initial delivery
⸻
Inputs You’ll Receive
• Sample story text (e.g. a chapter from The Lion, the Witch and the Wardrobe)
• Audio files (loops) for each text block
• Initial mapping of which paragraph triggers which audio
⸻
Timeline
• MVP build: 1–2 weeks
• Additional 1 week for polish/testing if needed
⸻
Budget
• Please propose a fixed price based on your estimate of the time required
• Open to fair day rates if needed — just be clear in your proposal
• Looking for someone who can start soon and work independently
The app will use the front-facing camera on the iPad to track the user’s gaze and trigger audio changes as they move through a story.
We are creating a new reading experience. As you read a story the soundtrack will change based on where you are in the text.
⸻
Core Features
1. Text Display (Apple Books Style)
• Fullscreen reading layout
• Clean, justified text layout with serif font (similar to Apple Books)
• Black text on white background
• Story text should be either scrollable or paginated
• Display must look like a proper e-book, not a notes app or text editor
2. Gaze-Responsive Music Playback
• The text will be split into paragraphs or blocks, each linked to a unique audio file
• When the user’s gaze dwells on a block for about 1 second:
• Trigger the corresponding audio loop
• Fade out the previous audio (or transition smoothly)
• Begin looping the new track
• If the user looks away or glances elsewhere, the current audio should continue looping
• If they return to a previously played block, audio should not restart
• The result should feel like a dynamic, mood-responsive soundtrack that adapts to the user’s place in the story — not one-to-one word syncing, but a flowing emotional bed that shifts as the narrative progresses
⸻
Flexibility Required
I need to be able to update the content myself. That means:
• I should be able to swap out the story text
• I should be able to change or replace audio files
• I should be able to define which paragraph triggers which audio using a simple config file (JSON, text file, or similar)
This can be done manually by editing files or dragging them into folders. No admin interface is needed — just clear folder structure and documentation so I can maintain it manually.
⸻
Technical Requirements
• Must use the SeeSo SDK by VisualCamp: https://seeso.io
• Target platform: iPad
• You can build in Swift or Unity — whichever tool you’re most comfortable with
• No user accounts, no cloud sync — everything runs locally on the device
• Final version must be distributed via TestFlight for testing
⸻
Deliverables
• iPad app installable via TestFlight
• Source files + clear instructions for editing text/audio/config
• One round of revisions or fixes after initial delivery
⸻
Inputs You’ll Receive
• Sample story text (e.g. a chapter from The Lion, the Witch and the Wardrobe)
• Audio files (loops) for each text block
• Initial mapping of which paragraph triggers which audio
⸻
Timeline
• MVP build: 1–2 weeks
• Additional 1 week for polish/testing if needed
⸻
Budget
• Please propose a fixed price based on your estimate of the time required
• Open to fair day rates if needed — just be clear in your proposal
• Looking for someone who can start soon and work independently

Chris P.
100% (4)Projects Completed
4
Freelancers worked with
4
Projects awarded
20%
Last project
21 Jul 2025
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies