MIXI, Inc.


The tech behind FamilyAlbum

FamilyAlbum is designed to help families easily save, share, and remember the special moments in their children’s lives. To help users look back on and preserve the high number of photos and videos uploaded every day with more convenience, FamilyAlbum utilizes machine learning—a technology for data analysis driven by artificial intelligence—to provide useful AI-based features, all while protecting privacy.


1s Movies and how they’re made

1s Movies are compilation videos we send to parents every season *1. These compilation videos are automatically generated using photos and videos uploaded to FamilyAlbum. We have received testimonials from parents saying that, amid their busy schedules, these videos help them cherish their children even more, and seeing their children’s growth in 1s Movies moves them to tears every time.

All photos and videos used in 1s Movies are selected using proprietary logic based on machine learning. Selection is performed in the following three stages.

(1) Facial/person recognition is performed on photos and videos using deep learning
First, we utilize deep learning to identify faces/people, with a particular emphasis on identifying children.

(2) A rating is assigned to each photo/video
Next, each photo/video is given a rating based on the results of facial/person recognition, as well as visibility settings, Favorite status, comments, and more.

(3) Photos/videos are selected and combined into a balanced 1s Movie
The 1s Movie is then put together, prioritizing selecting photos and videos that are highly rated. To ensure that each 1s Movie has variety and balance, many others factors are also considered, such as keeping a good ratio of photos to videos and selecting photos and videos taken throughout the entire season.

Similar selection techniques are also used in the automatic suggestions for other FamilyAlbum products, such as photo prints, photobooks, anniversary books, DVDs, and New Year cards.

Personal Pages

The Personal Pages feature automatically sorts photos and videos uploaded to FamilyAlbum by child. Besides allowing you to view your photos and videos by child *2, you can view them by categories such as all children and all family.

AI is also used in the creation of Personal Pages. We are able to automatically identify faces by getting the feature vectors for each face from photos and videos uploaded to FamilyAlbum, then use a machine learning technique called clustering to separate them into groups.

Personal Pages

This system is not perfect and still has difficulty differentiating between twins and other children that closely resemble each other, so we will continue working to improve its accuracy. FamilyAlbum will continue to utilize technology to provide a service that allows users to easily share cherished photos and videos of their children with family.

*1 Seasonal 1s Movies are distributed every three months to all users, but Premium subscribers also receive Monthly 1s Movies and Yearly 1s Movies.
*2 The Personal Pages feature requires FamilyAlbum Premium.