GKDemoMeeting

Time: Monday 10th Jun’13 11:00 A.M to Tuesday 11th June 5:30 P.M Location: IITD Called by: Prof. Santanu Chaudhury, Dr. Vijay Chandru, T.B Dinesh

I. Attendees

1. Prof. Santanu Chaudhury, IITD 2. Dr. Vijay Chandru (IIACD - on conference call) 3. T.B Dinesh, IIACD 4. Arvind, IIACD 5. Anon Ray, IIACD 6. Anupama Mallik, IITD 7. Neha Singh, IITD 8. Deepti Goel, IITD

II. Agenda Topics

1. The heritage site view in the Browser, that is to be explored by a user. Is it just a panorama view as currently shown or a more detailed view with various transitions and perspectives ?  2. What is the best way to show the theme of GirijaKalyana to a user through this interface ? Santanu Sir has some views on these two points. 3. To discuss a possible user interface for the GK demo and what it takes to annotate different media types...including videos, panoramas, images, pointclouds, murals, text .. 4. The format of the MPEG-7 compatible XML annotation files for images, audio, video and text. 5. The structure of SWeets, and how to convert from SWeets to XML. 6. Dinesh to explain the online annotation tools and how online annotation of text gives us Xpath for text segments. 7. Technology and platforms used by both teams so that a common ground is established.

III. Topics Discussed in Meeting

Monday 10th March :

1. Girijakalyana (GK) Visualization

It can be a computer based Demo with 2D and 3D elements. But it should have a script or a narrative to present the GK theme in a cohesive way, unlike the present demo which is more generic.

2. Corrections needed in the current GK demo : a. Remove factual errors. For e.g. Cover shows Vittala temple while ontology graph says Virupaksha temple. b. Captions are required with images that are displayed on screen, to explain why the image has been shown. c. Add a timeline and show some time related concepts in ontology, to allow for time traversal. d. Change the cover to allow for traversal or exploration of a non-linear GirijaKalyana narrative.

3. Scripting of GK theme for intellectual exploration through a non-linear narrative. Generate scripts for GK that consist of all the possible options relevant to displaying data (Images, Text, Videos, Point-clouds, etc.) and present it in the form of hyperlinks. Collection of narratives from classical as well as folklore, local-life perspective. It can start with narratives in local language and then move on to English narratives. Use Chaluvaraju’s resources for narratives.

4. XML Annotation format and its development from SWeets to be discussed in detail between technical teams of IITD and IIACD.

5. Until web-based rendering for media formats like video become standard and common across all web browsers, the teams will work on Mozilla FireFox as the browser for the demo.

6. The Girijakalyana demo may need consultants for the user interface design, and people from graphic design and HCI (human-computer interaction) background could give useful inputs. Some names discussed were Medha (NID), Aniruddh Joshi (Mumbai), Prabhaker (Bangalore).

7. In case DST project does not come through, we need to prepare the demo with Girijakalyana theme in order to present to some alternative funding agency, like Aga Khan Trust, INTACH.

8. The technical team of IIACD briefed the IITD team on web-based application development and what all technologies they have been using. Further discussions can take place in Bangalore when IITD team visits their Janastu office.

Tuesday 11th March

1. Anupama and Dinesh met with Malini Ghanathe, and discussed the possibility of her joining the team as the cultural resource for developing the Girijakalyana narrative/script in Delhi. She is travelling to Bangalore and will meet Prof. Chaluvaraju there. Before leaving, she will meet Prof. Chaudhury to understand the direction that the narrative should take.

2. Dinesh explained the structure of a SWeet to IITD team, and showed how it gets generated on the web, with examples from alipi.us, and janastu.org. He has promised to send the SWeets generated when the Lepakshi mural annotation takes place online. Deepti will then try and generate an XML for the mural from these SWeets. This will be the example on which the parameters required in the SWeets and SWeet->XML conversion will be based.

3. The cover frame of the GK demo, through which the site exploration takes place, was discussed. Dinesh showed some WebGL examples on the website threejs.org, and discussed how the cover can be generated using that technology.

A brief summary of the Technical Discussions is as following :

1. Client-Server Model for the GK Demo. 2. Xpath in DOM – how it is generated in a SWeet. 3. WebGL and open GL - threejs library. 4. AJAX and the use of File Transfer Protocols. 5. XML Annotation, which will be required for Images/Mural/Image Map Text Videos Audio Point cloud 3D Model 6. SWeet contains following information : Media format Details of Who, What, When, Where Reference of Ontology + Concept Attributes related to the ontology