AR Artwork (CS On-campus)
Imagine a world in which every mirror could create artwork right before your eyes. This project aims to make that a reality. Utilizing Artificial Intelligence over the course of the year this project group aims to create a working application that takes live video and transforms it into a moving painting in real time.
Objectives
Fall term
Description
The following steps have been done before and are not entirely unique. The steps to be completed in fall term already have several examples by which to use as an example and to improve upon in order to lay the groundwork for later steps.
Steps
Step 1: Data set acquisition
- Determine the largest possible set given the compute resources
- Split data sets for recognition training tasks
Step 2 Preliminary identification training and model building
- Facial recognition
- Text recognition
- Object recognition
Step 3 Artistic Implementation and model building
- IMage transformer
- Style differentiation
- Image Transformation
- DELIVERABLE: An AI model that is able to take an input image and transform it into the style of an artistic image.
Winter Term and Spring Term
Description
I believe this step will take the most time and will include making the previous model more efficient in order to process videos in real time.If real time rendering proves unrealistic or too much work is requires the previous model will be made more efficient and aided by up scaling the fps either by training another mode
Steps
Step 3 Speed Up and Process Video
- Frame by frame to video
- Optimization analysis
- Optimize data pipeline
- Optimize Neural Network and Hyperperameters
- FPS Upscaling if needed
Motivations
I have always been fascinated by both art and technology. When choosing a path of study in college I felt the two were incompatible and decided to study computer science. This project is the opportunity to combine the arts with the state of the art.
Qualifications
Minimum Qualifications:
None Listed Preferred Qualifications:
None Listed
Details
Project Partner:
Lucas Garcia
NDA/IPA:No Agreement Required
Number Groups:1
Project Status:Accepting Applicants