Due Wednesday, September 23rd at the beginning of class.
--
Select one of the following two prompts:
(A) Lost Childhood Object by Lenka Clayton:
or (B) Embarrassing Object by Geof Oppenheimer:
--
Using expanded capture techniques, realize the [lost/embarrassing] object virtually.
--
- Regardless of any intermediate processes or materials that your concept may or may not require (e.g. clay, papier-mache, etc.), your final project must be a virtual manifestation. Acceptable projects are limited to one of the following forms:
- a real-time software executable (created, for example, in Unity3D, openFrameworks, Processing, three.js, etc.) (Note: interactivity is optional).
- a video or computer-generated animation
- a computer-generated rendering
- Regardless of any subsequent digital transformations you might apply, you must "capture" "something" real (using a "device") as the initial basis for your virtual manifestation.
- Your virtual object must be presented on a neutral background.
- Create a Markdown document called
project1.mdin your student folder. You will document your project in this file. - In this document, write a couple of paragraphs (150-250 words) about the experience of creating the piece. Critique your work: where do you feel you succeeded? Where do you feel you fell short of what you'd hoped to achieve? What did you learn?
- All projects must be documented with at least one digital image at least 1600 pixels wide.
- With the exception of still renderings, all projects will be documented through online video hosted on YouTube or Vimeo, and linked from the
project1.mdpage. (Note, Markdown does not allow video embedding, so use the technique described here.) Software executables must be documented with a screencaptured video. - Optionally, you are invited to publish 3D files to sharing/hosting sites such as Thingiverse or Sketchfab.
- Submit your files (
project1.md, various images, etc.) in the form of a pull request to this repository.
--
One example of a possible solution might be something like this:
- Make a thing out of clay
- 3D scan it
- Bring it into Unity3D
- Add some sparkles, make it wiggle
- Record a screengrab video
Be more creative than that.
--
A list of references and viewings is available here.
--
Hardware Options:
-
Kinect (v1 and v2)
- oF
- p5
- Skanect (seems good for beginners)
- Kinect Fusion (pc) more info
- Fast to process
- Regular geometry
- real time feedback
- non cloud based
- free tool
- limited scale
- does not work in sunlight
- color is not very good
- requires specific sensor with wall power
- no texture map, per vertex color
- more on kinect fusion sdk
- DepthKit
-
Matter and Form 3D Scanner
More difficult, but still available:
- Pitt Orthopedics
- [Artec Space Spider] (https://www.youtube.com/watch?v=socspJqfkNE) (thanks to Yaser Sheikh) 3d scanner
- School of Art 3d scanner at the DAS
Software tools:
-
123D Catch works with any regular camera, even your cell phone
- works at any scale
- works outside
- generates a texture map
- Photographic quality in color
- slow to process
- cloud based
- dense geometry
- tools are not free and open
- no real time feedback
- more chaotic geometry
-
if you dont like 123D Catch - [Visual FSM & Meshlab] (http://www.instructables.com/id/Make-a-3D-model-from-pictures/?ALLSTEPS)
(all of the following is from James George)
OBJ and PLY files are commonly used open 3D file formats.
The free tool MeshLab provides a very handy way to convert formats. It's like a 3D pocket knife. We'll be using it not just for converting 3D files to different formats, but also reducing and combining meshes. *see below for how to reduce meshes using a few other applications
Here are some more comprehensive tutorials for cleaning geometry in MeshLab
After capturing your geo, the following links will help you get it into your preferred application
-
Unity3d Supports OBJ like any other 3D file format!
-
Processing The Saito OBJ loader Processing Library Tutorial Video (scrub to 3:30 for the good stuff)
-
OpenFrameworks The ofMesh and ofVboMesh objects support PLY's with color with the mesh .load() function. This is what you saw in class.
- The built in addon ofxAssimpModelLoader also works on OBJ files
-
[Satoru HIga has a nice OBJ loader addon:] (https://github.com/satoruhiga/ofxObjLoader)
-
Cinder
-
[Cinder has built in support for OBJ] (http://libcinder.org/docs/v0.8.3/classcinder_1_1_obj_loader.html)
-
[There is also a Mesh extension block that supports PLY] (https://github.com/simongeilfus/Cinder-OpenMesh)
-
[Meshes in cinder tutorial] (http://www.creativeapplications.net/tutorials/guide-to-meshes-in-cinder-cinder-tutorials/)
-
-
3D Printing
- NetFabb will help you clean up models if you wish to 3D print them. You'll want to take them through the STL format in MeshLab http://www.netfabb.com/downloadcenter.php?basic=1
Creative Tools: Many applications support OBJ (and sometimes PLY files)
-
Photoshop (really!) Photoshop natively supports importing and painting on 3D files! Check out this tutorial
-
After Effects The 3D Animator Pro plugin (they offer a free trial) accepts OBJ files video
-
Plexus is an amazing tool for After Effects that works on 3D geometry video
-
There is also mesh reduction tutorial for the free program Blender [video] (https://www.youtube.com/watch?v=ttU6Gz1W0Xw)
Programs like Maya, Cinema4D, Houdini, 3D Studio Max, Modo also work well with OBJ files but are beyond the scope of what we expect to teach in this class. But if you know these programs, by all means use them for your portraits.
Alignment
- [Meshlab 3D Scanning: Alignment] (http://youtu.be/4g9Hap4rX0k)
- [Alignment and Registration in CloudCompare] (http://www.danielgm.net/cc/doc/wiki/index.php5?title=Alignment_and_Registration )
- I've found that CloudCompare is really good for loading large pointclouds or found research data in lasercanning formats like .las, .xyz etc. and it will do a great job with Kinect or photogrammetry pointclouds.
Reduction & Remeshing
- Poisson Reconstruction in Meshlab - This is a good general purpose approach for Kinect or other pointclouds. Can also be used to combine meshes when used after "flatten visible layers" in Meshlab.
Color