{"id":14,"date":"2023-01-27T17:16:17","date_gmt":"2023-01-27T17:16:17","guid":{"rendered":"https:\/\/projects.etc.cmu.edu\/luminatti\/?p=14"},"modified":"2023-02-20T20:46:34","modified_gmt":"2023-02-20T20:46:34","slug":"week-2","status":"publish","type":"post","link":"https:\/\/projects.etc.cmu.edu\/luminatti\/week-2\/","title":{"rendered":"Week 2"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\" style=\"font-size:30px\"><strong>Core Hours:<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Monday&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 11AM &#8211; Noon, and 3PM &#8211; 7PM.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Tuesday &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 4PM &#8211; 7PM.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Wednesday&nbsp; &nbsp; 11AM &#8211; Noon, and 3PM &#8211; 7PM.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thursday&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 4PM &#8211; 7PM.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Friday &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Noon &#8211; 4PM.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Weekly Meeting with Faculty:&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Mo &amp; Heather<\/strong>: Every <strong>Wednesday at 11AM<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u3000<\/p>\n\n\n\n<p class=\"wp-block-paragraph\" style=\"font-size:30px\"><strong>Tech and Art Update:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The programmers and artists have started using TouchDesigners for basic testing.<\/li>\n\n\n\n<li>The programmers have started playing with Azure Kinect and it is able to track for now with obvious lagging. Tracking one person is working. Tracking two persons led to a system crash. Will work on this later this week.<\/li>\n\n\n\n<li>The artists have finished the first round of mood boards and have brought to Mikael for critique.&nbsp;<\/li>\n\n\n\n<li>The artists have finished a really early stage of TouchDesigner visual generation.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u3000<\/p>\n\n\n\n<p class=\"wp-block-paragraph\" style=\"font-size:30px\"><strong>Video Demo:<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In this week&#8217;s demo, we tested the very basics of the software Touch Designer, the hardware Azure Kinect, and the basic tracking and projection mapping. We explore several different gestures such as standing, T-posing, moving around, overlapping (multiple persons), etc.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Luminatti Week 2 Demo\" width=\"750\" height=\"422\" src=\"https:\/\/www.youtube.com\/embed\/TxJQo-Ppivs?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u3000<\/p>\n\n\n\n<p class=\"wp-block-paragraph\" style=\"font-size:30px\"><strong>Mikael\u2019s Update:<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/docs.google.com\/document\/d\/1ZW8_stm35YYGN6Ln859PVy7CytPO5Vseht-_6T75q5o\/edit#heading=h.b28zwhtkaqzi\">Here<\/a> is a document that he emailed us with performance guidelines&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Other than the previous deliverables, he wants to add a function to <strong>activate\/deactivate<\/strong> the visual treatment when needed (for specific parts of the acts).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Updated visual reference notes:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>Uga Aka:&nbsp;<br>The imagery of <strong>crystal <\/strong>onto performers\u2019 body.<br>Color Palette: Mono.<br>Images that accentuate the blackness of outer space, the womb, the primeval ocean, etc.&nbsp;<br><a href=\"https:\/\/imgur.com\/a\/1azsP9H\">odu patterns<\/a> coming out of <strong>hands <\/strong>and <strong>mouth <\/strong>and <strong>swirling on bodies<\/strong>; heighten moment<\/td><td><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/lh4.googleusercontent.com\/9zRIPTJ965l5UnwswJhRhpG87UkbR4GkJOWPvHPKP4rpU_VRb_BM7kbwTE1EJ8zPKuVF6bZuILAdNtW-0he7JG5MloHYxGNG9ONSXLIL82d3CLQUN4mqYLOYinPLVOJKwPQIvbqH5BubsFkNfrHGK6dSDrBJ2KvX48bCqAFYrotk0PeYPik8K0yVGQ4rhg\" width=\"194\" height=\"219\"><\/td><\/tr><tr><td>Uga Chi:&nbsp;<br>Mirrors and reflections are very important,&nbsp;<br>Color Palette: Mono.<br>Creating mirrored designs on each dancer\u2019s body<\/td><td><br><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/lh4.googleusercontent.com\/-F1SGIQrA-61IabD96y5QLJYVWm2yC2rOAxlaYocDW7s0LZLjLCftfc5Cctqkpto9NEGoHD1eZxBXAjFRMlRxySgzubAgRpNiSsfzXSXQNEgHJ6H95YTT8nb7L8aNL6oiwzHu11pQLRdTvSEczU2SBRL0U9UhgA5j_GS74vvuCcAOUaq-pJfi5KqcE64Gw\" width=\"240\" height=\"167\"><\/td><\/tr><tr><td>Uga Anwu:&nbsp;<br>replace the key word \u201cChaos\u201d with \u201cCivilization.\u201d&nbsp;<br>Color palette: golden.<br>Dancers as \u201cchildren of the rising sun.\u201d<br>The light of human intellect.<\/td><td><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/lh5.googleusercontent.com\/NzLjTW7xemb2O6EBQj-QD2_8tOMJP2V43xKh5-vR2t5YD6uzUFjpvFkuTp4Cr4HhF4Uz7eavMqU2yIsnRlDg6sQhsF8KgIhYUXtGKhxd5FYOEql4pSWugRMGmR6Al1HgusMKrroP3O4EYenLC67fGxD2hAaxF3XPLkxl3YwC7oV0kc9f5uRpHl7fncH3aw\" width=\"150\" height=\"155\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/lh4.googleusercontent.com\/8qhIZ1eUkMmBOnY-cRARIpcBU-qHX69UcNX8p7I0tRArXRLDCKI8J66wgw7OCUJB6_4ct6o1vo3t-VIZbYrQmi1wWGbbnDD-4-oQ729oRFPRD5jMv1h7WOyc_4R9f7jBsZXk5qx3CLpam9uxFiCrT1IF5z_GCYRRc6ZGmI3Gm2RmzZQzFpUpYZQYrTXeaQ\" width=\"124\" height=\"194\"><\/td><\/tr><tr><td>Uga Azi:<br>Important themes are: chaos, pessimism, suffering, hyperspeed, things upside down, sensory overload.<br>Color palette: not specified<\/td><td><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/lh6.googleusercontent.com\/DH5LYIkfAIiISWwnijtGo2oQVrC-TnSatsAkQCrxH0rLzzPyiTi61E-SCcej7Pv_VPwhN2UmiWUPSXN4_WLlhnJWdMFXRu1YdjGX0TWlELLZ9Lp72bCxnboBDZnDL2ZSlidMe4XWt0_Q2jbpJPKYyEY3ReIQ414ElRBWGcrOukDlafQ_dVRI0odKs0ZD4g\" width=\"193\" height=\"267\"><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Team\u2019s Questions and Concerns regarding the <a href=\"https:\/\/docs.google.com\/document\/d\/1ZW8_stm35YYGN6Ln859PVy7CytPO5Vseht-_6T75q5o\/edit#heading=h.b28zwhtkaqzi\">updated document<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u3000<\/p>\n\n\n\n<h1 class=\"wp-block-heading\" style=\"font-size:30px\">Questions:<\/h1>\n\n\n\n<p class=\"wp-block-paragraph\">Here are some of the questions we had during our meeting that we would love to talk to Mikael about:&nbsp;<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>For this entire project, we are working on <strong>Front Projection Mapping<\/strong> right? Mapping the performers horizontally only, as shown in the graph below. (And not mapping the performers from top to down, as if they are mostly lying and acting on the ground)<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh5.googleusercontent.com\/C1XYM-kr2FcjTLL30XUlGid1gh_wJzhptEBtH_CMdDv_BjM0KJh9dWxnNShynr2SfA9QiWV4JbPir2a-O-cuKsRnZWFhOrMcWMKAXLpECrSad_2zuIAgpKApleJdLnouwIYVNCbcnKhQ_SYEAQmfxIeryKY0e9gZMWVidYAJUy5KXn8ah1VgmGMfaLS6fw\" alt=\"\"\/><\/figure>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li><strong>How many projectors<\/strong> will there be? One for the background, and one for the projection mapping visual treatment for the performers? Or everything in one projector?<\/li>\n\n\n\n<li>When the visual treatment is <strong>deactivated<\/strong>, do you want us to still have the background, or do we shut off the background?<\/li>\n\n\n\n<li>For Act 1.5: \u201c<em>Dancers form 2 circles (inner circle and outer circle); they move in opposite directions looking up toward the <\/em><em>light<\/em>\u201d Where is the <strong>light source<\/strong> for this one? Will this be like a stage light? Or a light looking thing in the background visual?&nbsp;<\/li>\n\n\n\n<li>Will we need to make any <strong>audio <\/strong>(sound, music) for the visual treatment?<\/li>\n\n\n\n<li>When we have more questions, we will ask Mikael again.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">\u3000<\/p>\n\n\n\n<h1 class=\"wp-block-heading\" style=\"font-size:30px\">Concerns and Challenges:<\/h1>\n\n\n\n<p class=\"wp-block-paragraph\">Here are some of our challenges at this point based on the new <a href=\"https:\/\/docs.google.com\/document\/d\/1ZW8_stm35YYGN6Ln859PVy7CytPO5Vseht-_6T75q5o\/edit#\">guideline document<\/a> that Mikael sent to us over the last weekend.&nbsp;<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Performers\u2019 moving speed<\/strong>. We would imagine that this would be a problem throughout this project because there is a limit to what Azure Kinect is able to track, based on our tests at this moment. We are experiencing slow second to second frames performance (FPS), as well as lagging in terms of detecting body movement. For example, we are worried for Act 3.5 when: \u201c<em>Dancers do longer movement phrases and <\/em><em>\u2018fighting\u2019<\/em><em> movement<\/em>\u201d. If this is too fast, the device might have problem following it.,&nbsp;<\/li>\n\n\n\n<li><strong>Performers\u2019 overlapping and abnormal behaviors. <\/strong>Again, due to the technical limitations, when the performers overlap, there might be problems recognizing when they are grouped together (heavily overlapping). Also, when the performers are performing abnormal, not up-standing gestures, the device might also not be able to recognize the person. For example, we are worried for Act 1.5 when: <em>\u201cThey do a series of <\/em><em>laying down and standing up<\/em><em> to face the light (while still <\/em><em>in the circle<\/em><em>)\u201d<\/em> We assume here will be quite some overlapping and abnormal behaviors such as laying down.&nbsp;<\/li>\n\n\n\n<li><strong>Materials\/fabric of the clothing for the performers<\/strong>. Depending on what materials the performers will be wearing, the tracking effect\/efficiency might be different. We are still testing various sorts of fabric and we will keep Mikael Updated.&nbsp;<\/li>\n\n\n\n<li><strong>External Lighting<\/strong>. If there is a stage light, this may influence the effect of tracking and projection. For example, in Act 1.5: \u201c<em>Dancers form 2 circles (inner circle and outer circle); they move in opposite directions looking up toward the <\/em><em>light<\/em>\u201d&nbsp;<\/li>\n\n\n\n<li><strong>Projector(s) Problem<\/strong>. There is no one-projector that solves all scenarios. Different projectors are built for different types or rooms. A medium-size theater space is going to use a different type of projector compared to a smaller-size one. (Short throw vs long throw projector). The amount of brightness, the throw distance, the resolution, everything is quite site-specific. If the black box theater space (460 Melwood Avenue, Pittsburgh, PA 15213) is slightly bigger than ETC room 3306, the same projector may be applied. But if we are going to a bigger venue, we probably have to test the venue\u2019s projector to see if it works. We will look more into this, and hopefully put together a guideline for how to select the best projectors.&nbsp;<\/li>\n\n\n\n<li><strong>Performers distance against background wall.<\/strong> If the performer stands downstage right or left, the projection mapping onto their body will cast shadow onto the background. Such black silhouettes will be somewhat obvious onto the projection background. (If using two projectors, it might work because one projectors can be dedicated for projecting the background only. Only using one projector is very likely going to have the shadow if the performers stand far from the background)<\/li>\n\n\n\n<li><strong>Azure Kinect Accuracy<\/strong>. We are still testing how accurate the motion detection is for Azure Kinect.&nbsp;<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Core Hours: Monday&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 11AM &#8211; Noon, and 3PM &#8211; 7PM. Tuesday &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 4PM &#8211; 7PM. Wednesday&nbsp; &nbsp; 11AM &#8211; Noon, and 3PM &#8211; 7PM. Thursday&nbsp; &nbsp; &nbsp; &nbsp; [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":166,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-14","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-weekly-blog"],"_links":{"self":[{"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/posts\/14","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/comments?post=14"}],"version-history":[{"count":6,"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/posts\/14\/revisions"}],"predecessor-version":[{"id":181,"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/posts\/14\/revisions\/181"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/media\/166"}],"wp:attachment":[{"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/media?parent=14"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/categories?post=14"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/luminatti\/wp-json\/wp\/v2\/tags?post=14"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}