Creating animations of a human figure performing a task requires that the agent interact with objects in the environment in a realistic way. Agent-object interaction is not completely specified from a task description alone. In this paper we sketch an architecture for the Object-Specific Reasoner (OSR), an intermediate planning module which tailors high-level plans to the specifics of the agent and objects. As plans are elaborated, the OSR generates a sequence of motion directives which are ultimately executed by a simulator. Descriptions of failures can be used to identify possible tools for the agent to use. An Object-Specific Reasoner is necessary in a system which allows an agent, equipped with a set of action behaviors, to interact in a semiautonomous fashion with the world. Keywords object manipulation, motion planning, animation, tools Comments Presented at Toward Physical Interaction and Manipulation, AAAI Spring Symposium Series, 1994. This conference paper is available at ScholarlyCommons: http://repository.upenn.edu/hms/78 ! " #$ % & ' ( )* + ( -,. ' ( / 0 1 2'3 ,4 + 65' 7 3' 5 8 91:; )* =<=>?2@ A)B DC@) E F " G ' HJILK KNMOHQP.R;ITSGUWVOX Y?UWZ\[^]WV^_a`7b"]dc+eTP.Z f P.VNgGP4ZihjUWZlkim [^]WVOnoU+c P.epILV q/]WV csrtIp[/m eT]WgDITUWV u P.v ]WZDgD[wP.VNg UWh f UW[xv m gGP4Z ]WV cy_zV hjUWZD[^]Wg\I{UWVsr;|.ITP.V |}P ~iV IpRNP.Z S\ILgzMwUWhP.V V7SDM+eLR]WV I{] F ILeT]dc P.eLv IT] +B
}
}dWzddd eLIpK KNM7leLILV | X K ]dc+eTP.Za|}P.VNg\Z ]WeN`|.ITS}`m vBP4V V*`P c=m 7G+Dja+ ¡ pz¢¤£ ¥"¦ ̈§G©aa«G¬¦ ̈£L©D§®®¥ D£{© ̄\§A°¬±¦2§a§G© ̄§a3.} ́ §G©μ¦ ̈£{© ̄\§®4¶®G ̈¬ ·F ̧W1oz»1⁄21⁄443⁄4 ̈o ¿NÀLÁjÂDÃÅÄÆ Ç ÂDÆ.ÄÈQÂDÃÅÄÉDÆ¡ÊBÉLË*Â Ì ÍGÈQÂDÆQÎdÇDÍGÀpÁ ÏÐÁzÀ±ËÉDÀjÈQÄÆ Ç ÂFÃÅ ̈ʤÑÀLÁjÒ1⁄2Í ÄÀLÁÊ ÃÌGÂDà ÃÌ Á Â1⁄2ÇDÁzÆ.ÃBÄÆ4ÃÅÁ1⁄2ÀpÂ\ÓzÃQÔdÄÃÌ É ÕÖÁ¤ÓzÃÊ ÄÆ×ÃÌGÁlÁ1⁄2Æ4ØzÄÀLÉDÆ4ÈQÁ1⁄2Æ4ÃÙÄÆ'Â?ÀLÁjÂDÚÛıÊjÜ ÃÅÄÓ ÔdÂ\Ý2Þàß;Ç\ÁzÆ.ÃÅáDÉ ÕÖÁ¤ÓzÃ7ÄÆ.ÃÅÁzÀLÂDÓzÃÅÄÉDÆ$ÄÊFÆ4ÉDÃÙÓ¤ÉDÈ Ï ÚÛÁzÃÅÁ1⁄2ÚÛÝ ÊâÏÐÁ¤ÓzÄ Î;Á¤ãÙËÀLÉDÈ- ÃÅÂ2ÊjÑlã\ÁÊÓzÀ¤ÄäÏ ÃÅÄÉDÆ'Â\ÚåÉ\Æ4ÁæÞèçjÆ ÃÌ Ä±Ê ÏÐÂéÏÐÁzÀ ÔdÁ"ʤÑæÁzÃÅÓêÌ ÂDÆ'ÂDÀLÓêÌ ÄÃÅÁ¤ÓzÃÅÍGÀLÁQËÉDÀ ÃÌGÁ ë ÕÖÁ¤ÓzÃÜíì\ÏÐÁ¤ÓzÄ Î;Ó+î+ÁjÂ2ÊéÉDÆ.ÁzÀÙïðë+ì4îdñ ̈ò®ÂDÆ ÄÆ4ÃÅÁ1⁄2ÀjÈQÁ¤ãDÄÂ\ÃÅÁtÏ ÚÛÂDÆ4Æ.ÄÆGÇBÈQÉzã\Í ÚÛÁ ÔWÌGÄÓêÌ ÃÅÂDÄÚÛÉDÀðÊÙÌ ÄÛÇ ̈ÌDÜLÚÛÁzØzÁ1⁄2Ú\Ï ÚÛÂDÆaÊBÃÅÉ ÃÌ ÁQÊâÏÐÁ¤ÓzÄ Î;ÓêÊ ÉLËBÃÌ Á Â1⁄2ÇDÁzÆ.ÃNÂDÆ.ãÉGÕÖÁjÓ1⁄2ÃÊêÞ ßóÊ Ï}ÚåÂ\ÆaÊ*Â\ÀpÁôÁzÚÛ ÕðÉDÀLÂDÃÅÁjã2ò=ÃÌGÁ ë+ì.îõÇDÁzÆ.ÁzÀLÂDÃÅÁêÊ*ÂFÊÁ¤ÒzÍGÁzÆ4Ó¤ÁQÉLË ÈQÉDÃÅÄÉ\ÆlãDÄ±Ü ÀLÁ¤ÓzÃÅÄØzÁêÊAÔWÌ ÄÓÌ Â\ÀpÁ"ÍGÚÛÃÅÄÈQÂDÃÅÁ1⁄2ÚåÝ ÁöæÁ¤ÓzÍGÃÅÁ¤ãÕêÝl ÊéÄÈQÍ ÚÛÂDÃÅÉ\ÀéÞ(÷ÙÁÊÓzÀ¤ÄäÏ}ÃÅÄÉDÆ¡Ê É{Ë ËéÂ\ÄÚÛÍGÀpÁêÊ*Ó¤ÂDÆ?ÕTÁ ÍDÊÁ¤ãøÃÅÉ Äã\ÁzÆ4ÃÅÄ ËÝQÏÐÉ2ÊjÊÄùÕêÚÛÁ ÃÅÉzÉDÚúÊ+ËÉDÀQÃÌ ÁFÂzÇDÁ1⁄2Æ4à ÃÅÉ"Í\ÊéÁ ̈Þ ßóÆ ë ÕÖÁ¤ÓzÃÜíì\ÏÐÁ¤ÓzÄ Î;Ó î;Á¤Â ̈ÊÉDÆ4Á1⁄2À Ä±Ê Æ.ÁjÓ¤ÁʤÊÂDÀjÝJÄÆ Â ÊÝ1⁄2ÊéÃÅÁ1⁄2ÈwÔWÌ ÄÓêÌAÂ\ÚÚÛÉDÔWÊÙÂDÆ Â1⁄2ÇDÁzÆ.Ãò ÁjÒ1⁄2Í ÄûÏDÏÐÁ¤ã ÔdÄÃÌø ÊÁzÃ+ÉLË ÂDÓ1⁄2ÃÅÄÉDÆ?ÕðÁÌ ÂDØ1⁄2ÄÉ\ÀTʤò ÃÅÉøÄÆ4ÃÅÁ1⁄2ÀLÂDÓzÃ+ÄÆlÂüÊéÁ1⁄2È*Ä±Ü Â\Í ÃÅÉDÆ.ÉDÈQÉDÍ\ÊNË ̈ÊjÌGÄÉDÆ"ÔdÄÃÌ ÃÌ Á ÔdÉDÀ¤ÚÛã Þ ý þ=ÿ ÿ «aaaa4 LiDD« 4¦D ¦$¢¤Dμ aa«a£T LaL£Tμ G©±¢ õ¢¤D«G¬/¦ ̈§G©μ¦ ̈£T ¦ «aμ¦2§ 43\«aT G μ¦ \© ̄§a3 © ̄£QTz¦\¢ ÅDQ£ G©§a3 t3Dj¦D{al£ aμ daG©¢ i£ aμ-«aa®d\* ¦1⁄2¬ ?¦1⁄2¬D§a3 ¦"a4¦ ̈£ ©§ ¦ LμQ© ¦ ̈«a£T\§aDμ D«4 ¦\ G©D§ ̈ {«aaaa4 L"£ 4¦2£ DD«? ¦ ̈§G£ £T 3\§aj¦ ̈£TFTz¦æ¬å©L£{©±¢ â©μ*«G¬¦ ̈£{© ̄\§47 £ a*¢ 4¦ ̈j¦D¢¤£T a4 ÅDTμQ©§a3F\© 𧠣 £¤¦D a «aaaa. L Å«aT£ a £ 4¦2£ DD« 4¦ \ ¦ô£j¦D ¬ D¤¬d©§G£T í¦D¢¤ £T £ G©Ù¦ ̈3D§G£z®L £ 4¦ ̈£ÙD\« ¢¦2§ø32© \ ¢¤\μ μ¦ ̈§4aÙL«4¢ ¦D "! D $#% '&)(+*,&./+0 # # 1,! 32 ¶ azL G©3 ¬ D¤¬ GzT¢¤L©aa£L©D§4Ù ¦D¢¤£L©D§"μQ«4L£BLDμ a ̈@.*μ ¦ ̈aaa4z"£ðF£ a ¦ ̈3D§G£ 4 Ù¢¤D§G£TT ̈¬ ¬±¦2§a3D«4¦ ̈3DDÙ£ a ¢¤\μ μ¦ ̈§4 "! μQ«4L£W4 ¢¤D§ DT£Tzó£T Å«G¬Û¬ ̄ a4¦ ̈j¦2μ £TL©65zQμ \£TD ¢¤Dμôμ¦ ̈§4a G©¢ FLa4z¢ð© ÅAG£¤¦1⁄2©Û¬±+L«4¢ ¦D aT7D§ £ a 3 ̈¬¦DTd£ðB3Dj¦\La® a ̈ G©3 £TÙ¬Û© ù£+£ a 3 ̈¬¦DT ¦ ̈§4 aTJ£T L£j¦ ̈§4ô©§ 𤬱¦2£L©D§ £Tô£ aÙ3 ̈¬¦DT ¶++ ¢¤§ £T¤¦1⁄2¬ D4{7 æ¦ ̈£{© ̄\§4+μ D£L©6 ̈¦ ̈£T7£ G©++D }98%: \© ®T§G£+$;Ða4¦ ̈§4p© ̄\§4+ ¦Q£¤¦D ¦ ̈L©L ÅDB\© ®T§ £Q¦ ̈3D§G£jB¦2§4"Da Lz¢¤£j®¦ ̈§4=< : \© ®T§G£B$;aa4¦ ̈§4â©D§4Ù ¦ £¤¦D ¦ ̈L©L ùDQ\© 𧠣J©§ £ð§ £L©D§4 ́ £J£ aFT¦ ̈μ £{© ̄μôDN¢¤D§G£TT ̈¬Û¬Û©§a3 ¦2§G© ̄μ ¦ ̈£Tz 43D«aTzJT >\«G© ̄ðz La4z¢ð© ÅD©§a3 G£j¦1⁄2©Û¬W £ a=Gzp© ̄ðzQμ D£L©D§4 G©¢ ¦ ̈Ttj¦ ̈T¤¬BaaðzL§ £W©§ G©3 ¬ D¤¬®¢¤Dμ μ¦ ̈§4a «a+TzLz¦ ̈¤¢ Q©+¢¤D§4¢¤T§az =© ̄£ a«G©Û¬\©§a3A¦ ̈§ © ̄§G£TTμôz\©±¦2£TÙTz¦DL\§G© ̄§a3QLaL£Tμ G©¢ "μ¦ ̈a4 ¦Lμ ¦1⁄2¬Û¬L£7 G©3 ¬ D¤¬;¢¤\μ μ¦ ̈§4a £T £ aó¬¦ ̈§a3D«4¦ ̈3DJ d£ a*¦ ̈§G©μ¦2£L©D§ LÐ{£Tμ @? ¦ ̈ðQ©§ Dz{£L©3 ¦ ̈£L©§a3" a£ aJ£ G©Bμ ¦ ̈aaaG©§a3 ¢¦2§ 4FGD§a ¢¤D§4â©GL©§a3 ¦D¢¤£L©D§×¢¤\μ μ¦ ̈§4aJ©§$£TTμQ z¦D¢ צ23D§ £)4 JTzLD«aj¢¤zê+£ a D¡ pz¢¤£ ¦ ̈£T£ðL©a«a£Tz+£ a © ̄§G£T§G£L©D§® ¦2§4?£ a"â©£T«4¦ ̈£L©D§ ¶ a § £{© ̄ðøaaðТ¤zTô Ù¤¬¦ ̈4D¤¦ ̈£L©§a3 G©3 ¬ D¤¬*¢¤Dμ μ¦ ̈§4a ¢¦ ̈§F.BL§ ¦Dt3DT\«a§4\© ̄§a3FLGμQ4 ̈¬Û©¢B¦D¢¤£{© ̄\§AGzT¢¤{© ̄aa£{© ̄\§4 © ̄§BAú§ «aμ {©±¢ 4¡μ D£L©D§ GzT¢¤L©aa£L©D§4 ? Ù¦ ̈T7a«G©å¬\©§a3 £ aB ¡ pz¢¤£ a4z¢ð© ¢DC+z¦DLD§aFET CG:jG G©¢ © ©μ aG¬μ § £ðz ©§ £ aIHKJML"NPO N QSR LÐ{£Tμ a G©¢ © ̄£¤L¤¬ d©±7a4¦2T£ d£ a*·UT VXWZY\[?° TD Lz¢¤£]Ep·UT VXW¦ ̈£â©D§ ùT\μ^Y ¦ ̈£T«aj¦æ¬S[t¦ ̈§a3D«4¦ ̈3\]_í§4L£Tð«4¢¤£L©D§4$: ¦ ̈£+£ aa` §G©6 D¤â©£pF °W§a§4L\¬6 æ¦ ̈§G©¦Ub3c+° ?+d e ? cgf]h d e ij ¶ aJ3D ¦1⁄2¬® W£ aB ́7§G©μ lk aaT\ pz¢¤£+©+£ð 3D§aj¦ ̈£ðÙTz¦1⁄2¬Û©L£L©¢Q¦ ̈§G©μ¦ ̈£L©D§4+ «aμ¦2§ 43D«aTz7¢¦ ̈TT\©§a3 D«a£ £j¦\ Ð+La.z¢ð© 4z"£ aTD«a3 F§4¦ ̈£T«aj¦1⁄2¬ ¬¦ ̈§a3D«4¦23D7©§4L£TT«4¢¤£L©D§4 ¶ alHKJML"NPO N QSR LÐ{£Tμõ¢¤ Dj}£ adaG¬±¦2§*$;aa4¦ ̈§4â©D§Q¦ ̈§4Bp© ̄μQ«G¬¦ ̈£L©D§JaG¬¦ ̈§a§G©§a3Ba4\T£L©D§4 £ aÙ ́ §G©μ Fk aaTD Lz¢¤£ mln$m o+prqtsvuwq xyu{z}|t~Gxvxvq xyu~FxysPrqt
]x +©3 ¬ D¤¬BaG¬¦ ̈§a§G©§a3i© a. ÅDTμ ziG¦ μ aG«G¬Aå¦ ̈. D 4W£ a C ¶ a G© ̄3 ¬ ̄ \¤¬ aG¬±¦2§a§a+©+TzLa.D§4â©G¬ ÅDtTz¢¤D3D§G©65¤©§a3£ a £j¦\ a¦ ̈§4 L¤¬z¢¤£L©§a3 ùT\μ ¦ó¬Û©aj¦ ̈TF¦JaG¬¦ ̈§ £T ¦D¢¢¤Dμ aG¬Û© £ 4¦ ̈£Q£j¦D ¶ G©ôaG¬¦ ̈§a§a aTz¦ aQ£ aFaG¬¦ ̈§ G ̈ §i©§G£TlL£ða4] ÃÅ ̈ÊjÑ1⁄2Ü ÂDÓzÃÅÄÉDÆaÊ ÅD £ a ¦23D§ £7£T a4 ÅDTμ E ? G©Û¬ £ a G©3 ¬ D¤¬+aG¬±¦2§a§aÙμQ©3 £B¢¤\§4â©G 7 Dj7D3j j ] t7rPa$ Fj a j j¢¡j £¤j P ¡¢P¥ ¦ §]j¢ ̈ ¥)7 t©)P j¢7a jrj ¢a © «]¡¢7 ¡j¢g¬ £¢a]j]¢ g j¢¡j £ ¢ ¡P¢a¢ g¡j7¢ ̈ ,j )£ j ̄®,°±'j £ ¢)D2 t«F P Pj g¡j) 9 '¢ j¢¡j £¤j ¡jFj7 t£¤3 ¢ 7¡ ̈£ ) ¡j¢ £ ¢ K® ́§μP F¶ ¡j¢]j7¡¢ « 6£7 ¢7l¢ y)£ j )·jv a ) ̧ j ]jt£ ) «Uj7¡¢1 j y ¥)7 j@« vj £ ¢)K ̧"¢ ]j ¡ «v¢7¡jo¡j »§¡j¢y¢ ] ¬ 1⁄4¤t£ 1⁄2j a)£ j )K®3⁄4jj a¢ )¬ 1⁄4 t£ g a7g ¡¢ 6¿) 7 ]6« 7 jÀ¶ t«DP jv y)¬ 1⁄4 t£ P Áj 3 y j F£ § ® à £ azL £j¦\ ¦\¢¤£L©D§474¦Dâ©¢ôDÙaaL©μQ©£L©6 DDd£ a"¦ ̈T §a\£Ù§az¢¤zTT¦ ̈L©Û¬iaaL©μQ©£L©6 D ©§ £ðTμ £ aÙμ D£L©D§4+ G©±¢ μQ«4L£ 4Ba. ÅDTμ z : ct¤¬ ̄ ̈@£ aô CÙ®¦ â©μ*«G¬¦ ̈£ðD μ ¦ ̈§4¦ ̈3Dz μ D£T\ ¢¤D§G£TT ̈¬}©TL«az ÅDÙ¦ ̈3D§G£j ¦ ̈§4 D pz¢¤£j ¶ G©±óTz¦D¢¤£L©6 D·b ]C d ,cNð i μ aG«G¬ ̄QaaT \©GzBâ©£T«4¦ ̈£{© ̄\§4¦1⁄2¬ G§a ̈+¬zG3D £T £ a C Ep¦ ̈§4Q£ a G©3 ¬ D¤¬ aG¬¦ ̈§a§a :;¦ ̈§4ôT¤¬Û© ̄ \z+£ aJ C'¦ ̈§4ô£ a G©3 ¬ D¤¬WaG¬±¦2§a§a G£j¦1⁄2©Û¬+ ®μ \£L©D§aG¬¦ ̈§a§G©§a3F¦ ̈§4ôμ D£TD+¢¤D§G£TT ̈¬ ¶ a7Tz¦D¢¤£L©6 D7§4¦ ̈£T«aTÙ¦1⁄2¬Û¬ ̈ tμ¦ ̈§G μ D£L©D§¢¤\§ £Tð ̈¬¡Gz¢ð©â©D§4=£TÙ4 μ ¦DG+©§ £ðT§4¦1⁄2¬Û¬D4L«4¢ ¦D a ̈?£TB3\B¦ ̈TD«a§4Q\4L£j¦D¢ð¬z © ̄§ £ aÙTz¦D¢ FD+¬a¢¤Dμ D£{© ̄\§ a4¦ ̈£ ¶ aÙâ©μ*«G¬¦ ̈£ðDd©W©§ D Dzô+©£ G£¤¦1⁄2©Û¬ ̄z μôD£L©D§¢¤Dμôμ¦ ̈§4ad\ ÈQÉDÃÅÄÉDÆFãDÄÀpÁ¤ÓzÃÅÄØzÁêÊ ¶ a G©3 ¬ D¤¬BaG¬¦ ̈§a§a μQ©3 G£«4L"¦ L£Tai¬Û© D § 1 ̄ ) " } " ! £ a μ D£L©D§ ¢¤D§ £ðT ̈¬ LaL£Tμ a ̈+ Dz T >D«G©Tzô£ aFμ \£L©D§ \©Tz¢¤£L©6 D 1 ̄ £ð ©§4\©¢¦ ̈£T" G©¢ 4¦ ̈§4F£T «4LD. 4¦ ̈£7£L a.B d3DL©a"£T «4LD.£ a ¦ ̈aaaaTG¦D¢ · \z¢¤£TD ùD £ a 4¦ ̈§4}®¦2§4F£ a T3 ̈©D§F d£ aB\a pz¢¤£+£Tô3Dj¦DLa ¶ a aaðDG¬μ ©±ô£ G© \©±¢ aD£T\μ*?.£L;§$£j¦D ¦D¢¤£L©D§4ô¦ ̈§4?μ \£L©D§×\©Tz¢¤£L©6 Dz ¶ a G©3 ¬ D¤¬WaG¬±¦2§a§a G zt§aD£ §a ̈ §aD«a3 F¦ ̈.D«a£N£ a7a GÐâ©¢¦1⁄2¬ GzT¢¤{© ̄aa£{© ̄\§ ¦ ̈§ Da Lz¢¤£ £TFG£TTμ © ̄§aô£ aQ3DL©a â©£T §a¤©£ aBG zó£ a â©μQ«G¬±¦2£TD §a ̈@§aD«a3 ¦ ̈.D«a£ £ aQ©§ £ð§ £L©D§i4 G©§4 £ a¦D¢¤£{© ̄\§ £Tø{¤¬ ̄z¢¤£J£ a 3D{© ̄a p© ̄£ð _â£Ù©Ù£ a T ̈¬ £ aü C £T"aTz¦ i£j¦D ¦D¢¤£L©D§4J©§G£TlL£¤Q ù«G¬Û¬ {a4z¢ð© 4z'μôD£L©D§?\© ̄ðz¢¤£L©6 Dz ¶® 3\§aj¦ ̈£T Tz¦1⁄2¬Û©L£L©¢+4 4¦) \©DN 4£ a=p© ̄μQ«G¬¦ ̈£Tzô¦ ̈3D§G£dμ¦ ̈§G©aa«G¬¦ ̈£L©§a3BD¡ pz¢¤£jê ̈£ a ¦ ̈3D§G£ 4 a aâ©¢¦1⁄2¬ μ D£L©D§4+μQ«4L£ 4 Å«G¬å¬"Gz
[1]
George A. Bekey,et al.
A strategy for grasp synthesis with multifingered robot hands
,
1987,
Proceedings. 1987 IEEE International Conference on Robotics and Automation.
[2]
Jeffrey Esakov,et al.
An Investigation of Language Input and Performance Timing for Task Animation
,
1988
.
[3]
R. James Firby,et al.
An Investigation into Reactive Planning in Complex Domains
,
1987,
AAAI.
[4]
Timothy W. Bickmore,et al.
A basic agent
,
1990,
Comput. Intell..
[5]
Norman I. Badler,et al.
Instructions, Intentions and Expectations
,
1995,
Artif. Intell..
[6]
Michael Girard,et al.
Computer animation of knowledge-based human grasping
,
1991,
SIGGRAPH.
[7]
Russell H. Taylor,et al.
Automatic Synthesis of Fine-Motion Strategies for Robots
,
1984
.
[8]
James F. Allen.
Towards a General Theory of Action and Time
,
1984,
Artif. Intell..
[9]
D. McDermott.
Transformational Planning of Reactive Behavior
,
1992
.
[10]
Norman I. Badler,et al.
Simulating humans: computer graphics animation and control
,
1993
.
[11]
John E. Laird,et al.
Integrating, Execution, Planning, and Learning in Soar for External Environments
,
1990,
AAAI.
[12]
Rodney A. Brooks,et al.
A Robust Layered Control Syste For A Mobile Robot
,
2022
.
[13]
Christopher W. Geib,et al.
SodaJack: An Architecture For Agents That Search For And Manipulate Objects
,
1994
.
[14]
Joe Jackson,et al.
Knowledge-based prehension: capturing human dexterity
,
1988,
Proceedings. 1988 IEEE International Conference on Robotics and Automation.
[15]
Roger C. Schank,et al.
SCRIPTS, PLANS, GOALS, AND UNDERSTANDING
,
1988
.