Home | Alpha Telephone | Domain Names | Web Hosting | Get Traffic | xrEvidence | xrSoccer

United States Patent

Previous       Show 10       Next


United States Patent 5,648,813
Tanigawa ,   et al. July 15, 1997

Graphical-interactive-screen display apparatus and peripheral units


Abstract

A program receiver for displaying a graphical interactive picture by receiving a program transmitted from a program transmitter, the program receiver comprising: a storage unit for storing a plurality of basic picture elements in advance, the plurality of basic picture elements being figures composing the graphical interactive picture manipulated by a user; a signal receipt unit for receiving a signal transmitted from the program transmitter, the signal being a multiplex signal including a program and data specifying a structure of the graphical interactive picture; a signal separation unit for separating the signal received by the signal receipt unit into a program signal and a graphical-interactive-picture-structure specification data signal; a first graphical interactive picture generation unit for generating the graphical interactive picture by combining the basic picture elements stored in the storage unit based on the graphical-interactive-picture-structure specification data signal from the signal separation unit; and a display unit for displaying the graphical interactive picture generated by the first graphical interactive picture generation unit.


Inventors: Tanigawa; Hidekazu (Hirakata, JP), Mukai; Masaki (Izumisano, JP), Ohtsu; Takashi (Yawata, JP), Nakano; Yoshio (Takatsuki, JP), Tsuji; Seiji (Osaka, JP)
Assignee: Matsushita Electric Industrial co. Ltd. (Osaka-Fu, JP)
Appl. No.: 08/326,758
Filed: October 20, 1994

Foreign Application Priority Data

Oct 20, 1993 [JP] 5-262348
Nov 10, 1993 [JP] 5-281016
May 26, 1994 [JP] 6-112718

Current U.S. Class: 725/139 ; 348/461; 348/467; 348/473; 348/563
Current International Class: H04N 7/087 (20060101)
Field of Search: 348/6,7,12,13,10,461,467,468,473,476,478,486,706,563 453/5.1,3.1,6.1


References Cited

U.S. Patent Documents
5373324 December 1994 Kuroda et al.
5404393 April 1995 Remillard
Primary Examiner: Peng; John K.
Assistant Examiner: Flynn; Nathan J.
Attorney, Agent or Firm: Price, Gess & Ubell

Claims



What is claimed is:

1. A program receiver for displaying a graphical interactive picture by receiving a program transmitted from a program transmitter, said program receiver comprising:

storage means for storing a plurality of basic picture elements in advance, said plurality of basic picture elements being figures composing the graphical interactive picture manipulated by a user and said basic picture elements being composed of file names identifying each basic picture element and bit map data for each basic picture element;

signal receipt means for receiving a signal transmitted from said program transmitter, said signal being a multiplex signal including a program and data specifying a structure of the graphical interactive picture;

signal separation means for separating the signal received by said signal receipt means into a program signal and a graphical-interactive-picture-structure specification data signal;

first graphical interactive picture generation means for generating the graphical interactive picture by combining the basic picture elements stored in said storage means based on the graphical-interactive-picture-structure specification data signal from said signal separation means; and

display means for displaying the graphical interactive picture generated by said first graphical interactive picture generation means.

2. The program receiver of claim 1 further comprising:

interactive manipulation means for inputting manipulation to the graphical interactive picture displayed by said display means;

basic action storage means for storing a content of an action for updating the graphical-interactive-picture-structure specification data; and

second graphical interactive picture generation means for retrieving the content of the action from said basic action storage means based on action information directing an update of the graphical interactive picture upon receipt of the input manipulation from said interactive manipulation means to update the graphical-interactive-picture-structure specification data to generate an updated graphical interactive picture.

3. The program receiver of claim 2, wherein said first graphical interactive picture generation means includes:

a receipt.multidot.decode unit for receiving the graphical interactive-picture-structure specification data signal from said signal separation means to decode the same;

a storage unit for storing decoded graphical interactive-picture-structure specification data from said receipt.multidot.decode unit, the graphical-interactive-picture structure specification data being composed of a panel object definition including a plurality pieces of panel object information, an action definition including a plurality pieces of action information, and a shape definition including a plurality pieces of shape information;

a first process unit for retrieving the graphical interactive-picture-structure specification data from said storage unit, extracting the basic picture elements corresponding to the file names by referring to the shape information from said storage unit in accordance with the retrieved graphical-interactive-picture-structure specification data, and for placing the extracted basic picture elements by referring to the panel object information; and

a first display control unit for controlling the display means to display the basic picture elements placed by said first process unit as the graphical interactive picture.

4. The program receiver of claim 3, wherein said interactive manipulation means includes:

an input manipulation acceptance unit for accepting a user's input manipulation to the graphical interactive picture; and

an interactive signal transmission unit for transmitting the input manipulation accepted by said manipulation acceptance unit to said second graphical interactive picture generation unit as an interactive signal, and

wherein said second graphical interactive picture generation means includes:

an interactive signal receipt unit for receiving the interactive signal from said interactive signal transmission unit;

an interactive signal interpretation unit for interpreting the interactive signal received by said interactive signal receipt unit;

a graphical-interactive-picture-structure specification data update unit for retrieving a content of an action from said basic action storage means in accordance with the interactive signal interpreted by said interactive signal interpretation unit to update the graphical-interactive-picture-structure specification data in said storage unit;

a second process unit for retrieving updated graphical-interactive-picture-structure specification data from said storage unit, and for extracting the basic picture elements corresponding to the file names from said storage means to place the extracted display elements; and

a second display control unit for controlling said display means to display the basic picture elements placed by said second process unit as an updated graphical interactive picture.

5. The program receiver of claim 4 further comprising information transmission means for transmitting the data of the graphical interactive picture updated by said interactive manipulation means to said program transmitter.

6. The program receiver of claim 3 further comprising information transmission means for transmitting the data of the graphical interactive picture updated by said interactive manipulation means to said program transmitter.

7. The program receiver of claim 3 further comprising information record means for outputting data related to the graphical interactive picture as per manipulation form said interactive manipulation means to make a record thereof.

8. The program receiver of claim 2 further comprising information record means for outputting data related to the graphical interactive picture as per manipulation form said interactive manipulation means to make a record thereof.

9. The program receiver of claim 3 wherein said graphical-interactive-picture-structure specification data further includes a class definition including a plurality of pieces of class attribute information.

10. A program receiver for displaying a graphical interactive picture by receiving a program transmitted from a program transmitter, said program receiver comprising:

storage means for storing a plurality of basic picture elements in advance, said plurality of basic picture elements being figures composing the graphical interactive picture manipulated by a user and said basic picture elements being composed of file names identifying each basic picture element and bit map data for each basic picture element;

signal receipt means for receiving a signal transmitted from said program transmitter, said signal being a multiplex signal including a program and data specifying a structure of the graphical interactive picture;

signal separation means for separating the signal received by said signal receipt means into a program signal and a graphical-interactive-picture-structure specification data signal;

first graphical interactive picture generation means for generating the graphical interactive picture by combining the basic picture elements stored in said storage means based on the graphical-interactive-picture-structure specification data signal from said signal separation means, said first graphical interactive picture generation means comprising:

a receipt.multidot.decode unit for receiving the graphical interactive-picture-structure specification data signal from said signal separation means to decode the same;

a data division unit for dividing the decoded graphical-interactive-picture-structure specification data from said receipt.multidot.decode unit into a first graphical-interactive-picture-structure specification data and a second graphical-interactive-picture structure specification data, said first graphical interactive-picture-structure specification data excluding a synthesis instruction, said second graphical-interactive-picture-structure specification data including the synthesis instruction, the graphical interactive-picture-structure specification data being composed of a panel object definition including a plurality pieces of panel object information, an action definition including a plurality pieces of action information, a shape definition including a plurality pieces of shape information, and synthesis direction data including a synthesis command in case of the second graphical-interactive-picture-structure specification data;

a first graphical-interactive-picture-structure specification data storage unit for storing the first graphical-interactive-picture-structure specification data;

a second graphical-interactive-picture-structure specification data storage unit for storing the second graphical-interactive-picture-structure specification data;

a graphical interactive picture synthesis unit for synthesizing the first graphical-interactive-picture structure specification data in said first graphical interactive-picture-structure specification data storage unit and the second graphical-interactive-picture structure specification data in said second graphical interactive-picture-structure specification data storage unit in accordance with the synthesis command of the synthesis direction data stored in said second graphical-interactive-picture-structure specification data storage unit;

a graphical-interactive-picture-structure specification data update unit for updating the first graphical-interactive-picture-structure specification data in said first graphical-interactive-picture structure specification data storage unit with the synthesized graphical-interactive-picture-structure specification data from said graphical interactive picture synthesis unit;

a first process unit for retrieving updated graphical-interactive-picture-structure specification data from said first graphical-interactive-picture structure specification data storage unit, and for extracting the basic picture elements corresponding to the file names by referring to the shape information in said storage means to place the extracted basic picture elements by referring to the panel object information; and

a first display control unit for controlling said display means to display the basic picture elements placed by said first process unit as an updated graphical interactive picture;

display means for displaying the graphical interactive picture generated by said first graphical interactive picture generation means;

interactive manipulation means for inputting manipulation to the graphical interactive picture displayed by said display means;

basic action storage means for storing a content of an action for updating the graphical-interactive-picture-structure specification data; and

second graphical interactive picture generation means for retrieving the content of the action from said basic action storage means based on action information directing an update of the graphical interactive picture upon receipt of the input manipulation from said interactive manipulation means to update the graphical-interactive-picture-structure specification data to generate an updated graphical interactive picture.
Description



BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a display apparatus showing graphical interactive screens for remote control, and to the peripheral units.

2. Description of the Prior Art

The use of remote controllers has spread to facilitate the manipulation of today's household appliances such as audio-visual apparatuses, and one remote controller is furnished for one appliance in general. However, it is quite cumbersome to manage a plurality of remote controllers.

In addition, a remote controller in a broad sense, or a display on the screen that enables the users to make a variety of selections, was developed and has been in practical use for the interactive TV (television) system and TV game players. However, this type of remote controller also faces problems such as facilitating manipulation and saving manufacturing cost.

To eliminate the above problems, a multi-remote controller, or otherwise known as a system remote controller, was developed and has been commercially available. The multi-remote controller includes a transmitter that controls a plurality of appliances of various types in one kind (for example, TVs made by a plurality of makers), or various kinds of appliances (for example, TV and VTR (video tape recorder)), so that the user can control a plurality of appliances with one multi-remote controller by selecting the appliance he wishes to control. Alternately, the multi-remote controller may include the buttons necessary for the manipulation of all the appliances. However, in either case, the user must select a desired appliance first, meaning that the multi-remote controller must include the selection button.

To compensate the drawback of the multi-remote controller, Japanese Laid-Open Patent Application No. 2-180497 discloses a remote controller comprising a remote control unit for transmitting remote control signals for a plurality of appliances to be controlled, and receiver units furnished with each appliance for receiving the remote controller signals for their respective appliances. Note that each receiver unit transmits a unique signal to the remote controller unit, so that the receiver unit stores data as to which control signal should be transmitted to which appliance, eliminating the appliance selection process and hence the selection button.

However, this remote controller is available only to the predetermined appliances and functions, and it must include a ultra red ray signal transmitter and buttons for each predetermined function. Thus, although the selection button can be omitted, the remote controller still includes a large number of buttons if it controls more than one kind of appliance (for example, TV and VTR), because the buttons for channel selection and volume adjustment for the TV receiver, and those for playback and record functions for the VTR must be furnished separately. Further, the design of the remote controller can not be changed flexibly, and unnecessary buttons under a particular situation are still furnished and the control signals for such buttons are stored in the memory as well. Thus, neither the design is adequate nor the memory is utilized efficiently, complicating the manipulation of the remote controller more than necessary.

Also, a TV-VTR compound apparatus, which is controlled by menu information defined in .advance, has been developed However, it is impossible to control a plurality of appliances as an integral system; for the menu information varies depending on the state of each appliance, such as interconnection and power ON/OFF.

Further, a menu processing method, disclosed in Japanese Laid-Open Patent Application No. 3-233660, was developed. This method enables the retrieval of a desired application program by switching the menu displays regardless of which terminal or host computer stores the application program in a computer environment where a plurality of terminals are interconnected via a network.

However, the information as to which terminal or host computer stores the secondary and subsequent order menus must be written into each item in the menu in advance. Thus, it is impossible to control a plurality of appliances as an integral system; for the menu information varies depending on the state of each appliance, such as interconnection and power ON/OFF.

In addition, Japanese Laid-Open Patent Application No. 3-172086 discloses a program receiver which can display texts and graphics for the operation manual or guidance of the CATV (Cable TV) system, either related or unrelated to the program being broadcasted, on the screen. This will be explained more in detail while referring to FIG. 1 depicting the structure of the program receiver. A terminal 101 includes a character generator 103 for generating texts and graphics displayed on a screen 102, a memory 104 storing all the patterns for the texts and graphics transmitted from a head-end of the CATV station in advance, a switcher 107 for inputting signals from the character generator 103 or memory 104 into a TV receiver 106 instead of or together with the outputs from a tuner 105. The text and graphical information, or namely the operation manual or guidance and the information either related or unrelated to the program being broadcasted, is transmitted from the head end in advance to upgrade the utility of the CATV system.

In this system, program distributors supply the interactive screen generation information for each program to the CATV station in advance, so that the information is transmitted from the head-end to the memory 104 each time a program is switched, supplying an adequate interactive screen for each program. However, this complicates the retransmission of the program. As well, each time the user switches a channel, the head-end detects the switching and transmits the interactive screen generation information for the switched program to the memory 104, making the process it the head-end cumbersome.

In addition, a technique such that enables the user to set the functions of the VTR and TV game players by using the display on the TV receiver was developed. The household appliances of this type include a circuit for generating a user interface screen, and a terminal for outputting image signals generated by the circuit to an external appliances. The external output terminal is connected to an external image signal input terminal of the TV receiver via an image signal cable to switch TV receiver's signal input to the external image signal input terminal. Thus, the TV receiver displays the input image signal from the external image signal input terminal, supplying the user interface screen to the user.

The graphical display apparatus used for CAD (Computer Aided Design) also employs the user interface screen. Here, the host computer transmits figure definition instructions: combination and display position of basic elements (segments, arcs, characters, etc.), and attribution specification such as display allowance or disallowance. The graphical display apparatus interprets the figure definition instructions and then displays figures as per instructions on the screen. The definition of a figure composed of the same basic elements can be given only by copying the definition of the element and changing the display position attribute. Thus, the figure definition instructions for one element is transmitted from the host computer only once, saving the information transmission time for the host computer. However, in case of a multi-layer structure such as a menu manipulation screen to switch a layer as per user's instruction, the screen is cleared (the defined figure data are deleted) each time a layer is switched, and all the figure definition instructions are transmitted again for the switched layer. Alternately,. the figure data for all the layers may be defined in advance, and an instruction is sent each time a layer is switched to disallow the display of the attribute of the figure data in the currently displayed layer, and another instruction is sent to allow the display of the figure data for the switched layer.

However, using the user interface screen with the household appliances such as the VTR causes the following problems:

(1) the user-interface-screen generation circuit must be furnished for each appliance, causing the manufacturing cost to increase. Thus, this technique is applied only to limited appliances.

(2) the image input for the TV receiver must be switched to the external image signal input. This is not a drawback for the VTR or TV game players activated by switching the image input to the external image signal input. However, it is quite inconvenient if functions for an air conditioner or the like are set in this manner. Although such inconvenience can be eliminated by furnishing the user interface screen to the air conditioner, it costs more than furnishing the user-interface-screen generation circuit.

(3) the appliances and TV receiver must be connected via the image signal cable. Since the image signal cable is an essential component for the VTR and TV game player, this is not crucial for such appliances. However, this is quite inconvenient if the appliances, which can be used independently of the image signal cable, are controlled in this manner. Although such inconvenience can be eliminated by furnishing the user interface screen, it costs more than furnishing the user-interface-screen generation circuit as was with the secondly mentioned problem.

(4) the graphical display apparatus is connected to the host computer in the level of the basic elements to realize a variety of displays, thus many a figure definition instruction is received from the host computer when switching the display. This causes to increase the load in the host computer, and makes the real time transmission impossible if a high-transmission rate communication route is employed. More precisely, micro computers for the household appliances are less efficient compared with the one for host computer, and the transmission rate is set relatively low to save the transmission cost. Thus, it is not easy to display the graphical interactive screens on the graphical display apparatus using the display information.

SUMMARY OF THE INVENTION

Accordingly, the present invention has a first object to provide a remote controller which is easy to manipulate and does not hold the information of the appliances under the control thereof in advance, and thus uses resources such as a memory efficiently.

The present invention has a second object to provide a remote controller whose design can be changed flexibly depending on the state of the appliances under the control thereof.

The present invention has a third object to provide a remote controller which can synthesize the control menus for a plurality of appliances under the control thereof.

The present invention has a fourth object to provide a program receiver which can supply an adequate interactive screen for each program to the user.

The present invention has a fifth object to provide a graphical-interactive-screen display apparatus and the peripheral units which can display the user interface screens without using expensive user-interface-screen generation circuit, so that the user sets the functions for a desired appliance using such inexpensive user interface screens.

The first object can be fulfilled by a remote controller comprising a structure information supply unit for holding structure information for various types of appliances in advance, and a portable remote control unit for controlling the appliances, (1) the structure information supply unit including: a transmitter's structure information storage unit for storing the structure information, the structure information including control information for each appliance and object information, the control information being used by the remote control unit in controlling the appliances, the object information representing manipulation objects forming a manipulation unit of the remote control unit; and a structure information transmission unit for retrieving the control information and the object information from the transmitter's structure information storage unit to send the retrieved information to the remote control unit, (2) the remote control unit including: a structure information receipt unit for receiving the control information and the object information from the structure information transmission unit; a receiver's structure information storage unit for storing the control information and the object information received by the structure information receipt unit, a display unit for displaying a picture having a manipulation area used for manipulating the appliances; and a first display control unit for controlling the display unit to place the manipulation objects on the manipulation area based on the object information stored in the receiver's structure information storage unit.

The remote control unit may further include: a manipulation detection unit for detecting which manipulation object is manipulated on the manipulation area; a first control signal transmission unit for transmitting a control signal assigned for the manipulation object detected by the manipulation detection unit to the appliances based on the control information stored in the receiver's structure information storage unit, whereby the appliances operate in accordance with the control signal from the remote control unit.

The structure information supply unit may be installed in each appliance controlled by the control signal from the remote control unit.

To fulfill the second object, in the remote controller, the structure information supply unit may further include: a structure information generation unit for generating state-based control information depending on an action state of each appliance, the state-based control information being transmitted to the remote control unit by the structure information transmission unit; an object information generation unit for generating the object information depending on the action state of each appliance, the object information being transmitted to the remote control unit by the structure information transmission unit, and the remote control unit may further include: a generated information receipt unit for receiving the state-based control information from the structure information transmission unit; a generated information update unit for updating the control information and the object information in the receiver's structure information storage unit in accordance with the state-based control information received by the generated information receipt unit; a second control signal transmission unit for transmitting a control signal assigned to the manipulated object detected by the manipulation detection unit to the appliances based on updated control information stored in the receiver's structure information storage unit; a generated object information receipt unit for receiving updated object information from the structure information transmission unit; and a second display control unit for controlling the display unit to place updated manipulation objects on the manipulation area based on the updated object information received by the generated object information receipt unit.

The third object can be fulfilled by a synthesis apparatus including a plurality of appliances for synthesizing menu information withheld by each appliance, the menu information being hierarchical information enabling a user to control the appliances interactively, (1) one of the plurality of appliances including: a first menu storage unit for storing first menu information, the first menu information being hierarchical information to be used to control the one appliance; a menu information receipt unit for receiving the menu information from the other appliances; a menu information synthesis unit for synthesizing the menu information received by the menu information receipt unit and first menu information stored in the first menu information storage unit, resulting synthesized menu information being used as a menu-information selection menu at a highest position in a hierarchy; and a menu display unit for displaying the menu-information selection menu generated by the menu information synthesis unit, (2) each of the other appliances including: a menu storage unit for storing the menu information unique to each appliance, the menu information being hierarchical information to be used to control each appliance; and a menu transmission unit for transmitting the unique menu information in the menu storage unit to the one appliance.

The one appliance may further include a synthesis rule storage unit for storing rules regulating menu-information synthesis by the menu information synthesis unit, whereby the menu information synthesis unit synthesizes the menu information from the other appliances and the first menu information in accordance with the synthesis rules.

The menu transmission unit may include: a menu information retrieval direction unit for detecting a connection with the one appliance and for giving a direction to retrieve the menu information; a menu information retrieval unit for retrieving the menu information from the menu storage unit upon receipt of the direction from the menu information retrieval direction unit; and a menu transmission unit for transmitting the menu information retrieved by the menu information retrieval unit to the menu information receipt unit.

The menu information synthesis unit may include: a menu selection acceptance unit for accepting a selection of an appliance subject to control manipulation using the menu-information selection menu displayed by the menu display unit; a menu information retrieval unit for retrieving the menu information of the appliance accepted by the menu selection acceptance unit from the menu information synthesis unit; and a menu switch control unit for changing a display on the menu display unit in accordance with the menu information retrieved by the menu information retrieval unit.

The menu information synthesis unit may further include: a menu information temporarily storage unit for temporarily storing the menu information received by the menu information receipt unit; a first menu information retrieval unit for retrieving the first menu information from the first menu storage unit; a synthesis rule retrieval unit for retrieving the synthesis rules from the synthesis rule storage unit, the synthesis rules including a synthesis rule for a hierarchial structure, a selection rule for a displayed shape, a synthesis rule for a panel object, and a synthesis rule for control of the appliances; and a hierarchial structure synthesis unit for synthesizing the menu information stored in the menu information temporarily storage unit and the first menu information retrieved by the first menu information retrieval unit in accordance with the hierarchical synthesis rule retrieved by the synthesis rule retrieval unit.

The menu information synthesis unit may further include: a menu information temporarily storage unit for temporarily storing the menu information received by the menu information receipt unit; a first menu information retrieval unit for retrieving the first menu information from the first menu storage unit; a synthesis rule retrieval unit for retrieving the synthesis rules from the synthesis rule storage unit, the synthesis rules including a synthesis rule for a hierarchial structure, a selection rule for a displayed shape, a synthesis rule for a panel object, and a synthesis rule for control of the appliances; and a hierarchial structure synthesis unit for synthesizing the menu information stored in the menu information temporarily storage unit and the first menu information retrieved by the first menu information retrieval unit in accordance with the hierarchical synthesis rule retrieved by the synthesis rule retrieval unit.

The third object also can be fulfilled by in a remote control system comprising a plurality of appliances and a remote controller for transmitting control signals to the plurality of appliances, (1) the remote controller including: a menu information request transmission unit for transmitting a menu information request to each appliance, the menu information being hierarchial information unique to each appliance for enabling a user to control each appliance interactively; a menu receipt unit for receiving the menu information transmitted from each appliance; a menu information synthesis unit for synthesizing the menu information received by the menu receipt unit; a menu display unit for visually displaying synthesized menu information generated by the menu information synthesis unit; an input manipulation unit for accepting a user's input manipulation to control the appliances; and a control signal transmission unit for transmitting the control signals to the appliances based on the input manipulation accepted by the input manipulation unit, (2) each appliance including: a menu information request receipt unit for receiving the menu information request from the menu information request transmission unit; a menu information transmission unit for transmitting the menu information to the menu receipt unit when the menu information request receipt unit receives the menu information request; a control signal receipt unit for receiving the control signals from the control signal transmission unit; and a control unit for controlling the appliances as per control signals received by the control signal receipt unit.

The menu information synthesis unit may include: a menu information storage unit for storing the menu information of each appliance received by the menu receipt unit, the menu information being hierarchical information including a panel object name and shape information; a synthesis rule storage unit for storing synthesis rules regulating menu-information synthesis, the synthesis rules including a synthesis rule for a hierarchial structure, a synthesis rule for a panel object, a selection rule for a displayed shape, and a synthesis rule for control of the appliances; a menu synthesis unit for synthesizing the menu information of the appliances stored in the menu information storage unit into one hierarchical structure in accordance with the hierarchical synthesis rules in the synthesis rule storage unit; a panel object synthesis unit for synthesizing the menu information of the appliances in the menu information storage unit into one panel object in accordance with the synthesis rule for the panel object stored in the synthesis rule storage unit, the synthesis rule for the panel object being to synthesize the menu information identified by an identical panel object name; a shape synthesis unit for making the shape information uniform for each appliance for the menu information in the menu information storage unit in accordance with the selection rule for the displayed shape in the synthesis rule storage unit, the selection rule being to select the shape information of a specified appliance and apply the same to the shape information for each appliance for the menu information in the menu information storage unit; and an action append unit for inserting data as to an control action in accordance with the synthesis rule for the control of the appliances, the synthesis rule for the control being to insert the data as to the control action described by the synthesis rule for the control at a position specified by the synthesis rule for the control.

The menu display unit may include: a bit map data conversion unit for converting the menu information synthesized by the menu synthesis unit, panel synthesis unit, shape synthesis unit, and action append unit into bit map data for a visual display; a display unit for displaying the menu information converted into the bit map data by the bit map data conversion unit; a first manipulation acceptance unit for accepting a user's selection of menu displayed by the display unit; and a selected menu notice unit for notifying a menu selected and accepted by the first manipulation acceptance unit to the menu information synthesis unit.

The menu information synthesis unit may further include a menu information retrieval unit for retrieving the menu information from the menu storage unit for the appliance corresponding to the menu notified by the selected menu notice unit, retrieved menu information including information as to manipulation objects displayed by the display unit, and the menu display unit may further include: a menu information conversion unit for converting the menu information retrieved by the menu information retrieval unit into the bit map data, the menu information retrieved by the menu information retrieval unit including information as to a display of manipulation objects displayed by the display unit; a change-menu display control unit for controlling the display unit to display the menu information converted into the bit map data by the menu information conversion unit; a second manipulation acceptance unit for accepting a user's control manipulation related to a control over the appliance using the manipulation objects displayed by the display unit; and a manipulation notice unit for notifying the control manipulation accepted by the second manipulation acceptance unit to the control sinal transmission unit.

The fourth object can be fulfilled by a program receiver for displaying a graphical interactive picture by receiving a program transmitted from a program transmitter, the program receiver comprising: a storage unit for storing a plurality of basic picture elements in advance, the plurality of basic picture elements being figures composing the graphical interactive picture manipulated by a user; a signal receipt unit for receiving a signal transmitted from the program transmitter, the signal being a multiplex signal including a program and data specifying a structure of the graphical interactive picture; a signal separation unit for separating the signal received by the signal receipt unit into a program signal and a graphical-interactive-picture-structure specification data signal; a first graphical interactive picture generation unit for generating the graphical interactive picture by combining the basic picture elements stored in the storage unit based on the graphical-interactive-picture-structure specification data signal from the signal separation unit; and a display unit for displaying the graphical interactive picture generated by the first graphical interactive picture generation unit.

The program receiver may further comprise: an interactive manipulation unit for inputting manipulation to the graphical interactive picture displayed by the display unit; a basic action storage unit for storing a content of an action for updating the graphical-interactive-picture-structure specification data; and a second graphical interactive picture generation unit for retrieving the content of the action from the basic action storage unit based on action information directing an update of the graphical interactive picture upon receipt of the input manipulation from the interactive manipulation unit to update the graphical-interactive-picture-structure specification data to generate an updated graphical interactive picture.

The basic picture elements in the storage unit may be composed of file names identifying each basic picture element and the bit map data for each basic picture element, and the first graphical interactive picture generation unit may include: a receipt.multidot.decode unit for receiving the graphical-interactive-picture-structure specification data signal from the signal separation unit to decode the same; a storage unit for storing decoded graphical-interactive-picture-structure specification data from the receipt.multidot.decode unit, the graphical-interactive-picture-structure specification data being composed of a class definition including a plurality pieces of class attribute information, a panel object definition including a plurality pieces of panel object information, an action definition including a plurality pieces of action information, and a shape definition including a plurality pieces of shape information; a first process unit for retrieving the graphical-interactive-picture-structure specification data from the storage unit, extracting the basic picture elements corresponding to the file names by referring to the shape information from the storage unit in accordance with the retrieved graphical-interactive-picture-structure specification data, and for placing the extracted basic picture elements by referring to the panel object information; and a first display control unit for controlling the display unit to display the basic picture elements placed by the first process unit as the graphical interactive picture.

The interactive manipulation unit may include: an input manipulation acceptance unit for accepting a user's input manipulation to the graphical interactive picture; and an interactive signal transmission unit for transmitting the input manipulation accepted by the manipulation acceptance unit to the second graphical interactive picture generation unit as an interactive signal, and the second graphical interactive picture generation unit may include: an interactive signal receipt unit for receiving the interactive signal from the interactive signal transmission unit; an interactive signal interpretation unit for interpreting the interactive signal received by the interactive signal receipt unit; a graphical-interactive-picture-structure specification data update unit for retrieving a content of an action from the basic action storage unit in accordance with the interactive signal interpreted by the interactive signal interpretation unit to update the graphical-interactive-picture-structure specification data in the storage unit; a second process unit for retrieving updated graphical-interactive-picture-structure specification data from the storage unit, and for extracting the basic picture elements corresponding to the file names from the storage unit to place the extracted display elements; and a second display control unit for controlling the display unit to display the basic picture elements placed by the second process unit as an updated graphical interactive picture.

The program receiver may further comprise an information transmission unit for transmitting the data of the graphical interactive picture updated by the interactive manipulation unit to the program transmitter.

The basic picture elements in the storage unit may be composed of file names identifying each basic picture element and the bit map data for each basic picture element, and the first graphical interactive picture generation unit may include: a receipt.multidot.decode unit for receiving the graphical-interactive-picture-structure specification data signal from the signal separation unit to decode the same; a data division unit for dividing the decoded graphical-interactive-picture-structure specification data from the receipt.multidot.decode unit into a first graphical-interactive-picture-structure specification data and a second graphical-interactive-picture-structure specification data, the first graphical-interactive-picture-structure specification data excluding a synthesis instruction, the second graphical-interactive-picture-structure specification data including the synthesis instruction, the graphical-interactive-picture-structure specification data being composed of a panel object definition including a plurality pieces of panel object information, an action definition including a plurality pieces of action information, a shape definition including a plurality pieces of shape information, and synthesis direction data including a synthesis command in case of the second graphical-interactive-picture-structure specification data; a first graphical-interactive-picture-structure specification data storage unit for scoring the first graphical-interactive-picture-structure specification data; a second graphical-interactive-picture-structure specification data storage unit for storing the second graphical-interactive-picture-structure specification data; a graphical interactive picture synthesis unit for synthesizing the first graphical-interactive-picture-structure specification data in the first graphical-interactive-picture-structure specification data storage unit and the second graphical-interactive-picture-structure specification data in the second graphical-interactive-picture-structure specification data storage unit in accordance with the synthesis command of the synthesis direction data stored in the second graphical-interactive-picture-structure specification data storage unit; a graphical-interactive-picture-structure specification data update unit for updating the first graphical-interactive-picture-structure specification data in the first graphical-interactive-picture-structure specification data storage unit with the synthesized graphical-interactive-picture-structure specification data from the graphical interactive picture synthesis unit; a first process unit for retrieving updated graphical-interactive-picture-structure specification data from the first graphical-interactive-picture-structure specification data storage unit, and for extracting the basic picture elements corresponding to the file names by referring to the shape information in the storage unit to place the extracted basic picture elements by referring to the panel object information; and a first display control unit for controlling the display unit to display the basic picture elements placed by the first process unit as an updated graphical interactive picture.

The program receiver may further comprise an information record unit for outputting data related to the graphical interactive picture as per manipulation form the interactive manipulation unit to make a record thereof.

The fifth object can be fulfilled by a system including peripheral appliances holding graphical interactive picture structure data and a display unit for displaying a graphical interactive picture for the peripheral appliances by receiving a unique manipulation direction signal from each peripheral appliance, the display unit including: a graphical interactive picture structure data receipt unit for receiving the graphical interactive picture structure data from the peripheral appliances to generate the graphical interactive picture; a display's graphical interactive picture structure data storage unit for storing the graphical interactive picture structure data received by the graphical interactive picture structure data receipt unit; a graphical display element storage unit for storing a plurality of graphical display elements to generate the graphical interactive picture; a manipulation direction signal receipt unit for receiving the manipulation direction signal from the peripheral appliances; a graphical interactive picture generation unit for receiving the manipulation direction signal received by the manipulation direction signal receipt unit, and for retrieving the graphical interactive picture structure data from the display's graphical interactive picture structure data storage unit to generate the graphical interactive picture by combining the graphical display elements stored in the graphical display element storage unit; and a display unit for displaying the graphical interactive picture generated by the graphical interactive picture generation unit.

The graphical interactive picture generation unit may include: a temporarily storage unit for temporarily storing the manipulation direction signal received by the manipulation direction signal receipt unit; a retrieval unit for retrieving the manipulation direction signal from the temporarily storage unit; a graphical interactive picture structure data extract unit for extracting the graphical interactive structure data from the display's graphical interactive picture structure data storage unit in accordance with the manipulation direction signal retrieved by the retrieval unit to generate the graphical interactive picture, the graphical interactive picture structure data including object information defining objects that form the graphical interactive picture, shape information defining shapes of the objects, position information defining positions of the objects, action information defining the objects' actions that change the graphical interactive picture based on the manipulation direction signal; a graphical display element extract unit for extracting bit map data from the graphical display element storage unit based on the shape information extracted by the graphical interactive picture structure data extract unit, the bit map data being stored in the graphical display element storage unit in relation with the shape information; a synthesis generation unit for generating a graphical display by synthesizing the bit map data extracted by the graphical display element extract unit and an attribute value of a character string attribute of each object, the attribute value of the character string attribute displayed on the bit map data being included in the object information; a placement unit for placing the graphical display synthesized by the synthesis generation unit based on the position information in the graphical interactive picture structure data.

The graphical interactive picture generation unit may further include a graphical interactive picture structure data update unit for updating a content of the graphical interactive picture structure data in the display's graphical interactive picture structure data storage unit based on the action information extracted by the graphical interactive picture structure data extract unit when the manipulation direction signal retrieved by the retrieval unit is an update direction.

The display unit may further include: a TV receiver unit for converting a received program into an image; a TV manipulation unit for accepting a manual manipulation to the TV receiver unit; a TV's graphical interactive picture structure data storage unit for storing the graphical interactive picture structure data related to the TV receiver unit in advance; and a TV's interactive picture generation unit for retrieving the graphical interactive picture structure data from the TV's graphical interactive picture structure data storage unit when the TV manipulation unit receives the manual manipulation to generate the graphical interactive picture by combining the graphical display elements in the graphical display element storage unit to update the graphical interactive picture each time a manual manipulation is received by the TV manipulation unit.

Each peripheral appliance may include: a manipulation unit for accepting a user's action direction addressed to a self's peripheral appliance; a user's graphical interactive picture structure data storage unit for storing the graphical interactive picture structure data to display the graphical interactive picture as per action direction accepted by the manipulation unit; a control unit for controlling the self's peripheral appliance to set a function by giving a direction to transmit the graphical interactive picture structure data and generating a manipulation direction signal to generate the graphical interactive picture and a manipulation direction signal to updated graphical interactive picture upon acceptance of the action direction from the manipulation unit; a graphical interactive picture structure data transmission unit for retrieving the graphical interactive picture structure data from the user's graphical interactive picture structure data storage unit upon receipt of the transmission direction from the control unit, and for transmitting the retrieved graphical interactive picture structure data to the display unit; and a manipulation direction signal transmission unit for transmitting the manipulation direction signal generated by the control unit to the display unit.

The control unit may include: a first signal generation unit for generating the manipulation direction signal as per action direction from the manipulation unit; and a second signal generation unit for generating a predetermined subsidiary data signal depending on current action state of the self's peripheral appliance, the subsidiary data being a supplement of the graphical interactive picture structure data and constituting an integral part thereof, the subsidiary data signal being generated by the first signal generation unit together with the manipulation direction signal.

The manipulation unit may be portable.

The fifth object also can be fulfilled by a system comprising a remote controller for controlling peripheral appliances and a display unit for displaying a graphical interactive picture as per manipulation direction signal from the remote controller, (1) the remote controller including: a manipulation unit for accepting an action direction addressed to the remote controller; a control unit for controlling the remote controller to set a function upon acceptance of the action direction from the manipulation unit, and for generating a manipulation direction signal to generate the graphical interactive picture and a manipulation direction signal to update the graphical interactive picture; a manipulation direction signal transmission unit for transmitting the manipulation direction signal generated by the control unit to the display unit, (2) the display unit including: an appliance's graphical interactive picture structure data storage unit for storing the graphical interactive picture structure data in advance to generate the graphical interactive picture for the peripheral appliances; a graphical display element storage unit for storing a plurality of graphical display elements to generate the graphical interactive picture; a manipulation direction signal receipt unit for receiving the manipulation direction signal from the remote controller; a graphical interactive picture generation unit for retrieving the graphical interactive picture structure data from the appliance's graphical interactive picture structure data storage unit upon receipt of the manipulation direction signal received by the manipulation direction signal receipt unit to generate the graphical interactive picture by combining the graphical display elements stored in the graphical display element storage unit based on the retrieved graphical interactive picture structure data; a display unit for displaying the graphical interactive picture generated by the graphical interactive picture generation unit; a TV receiver unit for converting a received TV program into an image; a TV manipulation unit for accepting a manual manipulation to the TV receiver unit; a TV's graphical interactive picture structure data storage unit for storing the graphical interactive picture structure data as to the TV receiver unit in advance; a TV's graphical interactive picture generation unit for retrieving the graphical interactive picture structure data from the TV's graphical interactive picture structure data storage unit when the TV manipulation unit receives the manual manipulation to generate the graphical interactive picture by combining the graphical display elements stored in the graphical display element storage unit based on the retrieved graphical interactive picture structure data to update the graphical interactive picture each time the TV manipulation unit receives a manual manipulation.

The fifth object can be fulfilled by a system comprising a relay, a remote controller, and a display unit, the relay being a peripheral appliance for transferring an action direction signal from the remote controller to the display unit, the relay's function being set by the remote controller, the display unit displaying a graphical interactive picture upon receipt of the signal from the relay, (1) the remote controller including: a first manipulation unit for accepting an action of the remote controller; a first graphical interactive picture structure data storage unit for storing graphical interactive picture structure data in advance to generate the graphical interactive picture as per action direction; a first control unit for controlling the remote controller to set a function upon receipt of the action direction from the first manipulation unit by giving a direction to transmit the graphical interactive picture structure data and generating a manipulation direction signal to generate the graphical interactive picture and a manipulation direction signal to update the graphical interactive picture; a first graphical interactive picture structure data transmission unit for retrieving the graphical interactive picture structure data from the first graphical interactive picture structure data storage unit upon receipt of the transmission direction from the first control unit to transmit the same to the relay; and a first manipulation direction signal transmission unit for transmitting the manipulation direction signal generated by the first control unit to the relay, (2) the relay including: a second manipulation unit for accepting an action direction addressed to the relay; a user's graphical interactive picture structure data storage unit for storing the graphical interactive picture structure data in advance to generate the graphical interactive picture as per action direction addressed to the relay; a second control unit for controlling the relay to set a function upon receipt of the action direction from the second manipulation unit by giving a direction to transmit the graphical interactive picture structure data and generating a manipulation direction signal to generate the graphical interactive picture and a manipulation direction signal to update the graphical interactive picture; a graphical interactive picture structure data transmission unit for retrieving the graphical interactive picture structure data from the user's graphical interactive picture structure data storage unit upon receipt of the transmission direction from the second control unit to transmit the same to the display unit; a second manipulation direction signal transmission unit for transmitting the manipulation direction signal generated by the second control unit to the display unit; a data relay unit for receiving the graphical interactive picture structure data from the first graphical interactive picture structure data transmission unit to transmit the same to the display unit; and a signal relay unit for receiving the manipulation direction signal from the first manipulation direction signal transmission unit to transmit the same to the display unit, (3) the display unit including: a graphical display element storage unit for storing a plurality of graphical display elements to generate the graphical interactive picture; a graphical interactive picture structure data receipt unit for receiving the graphical interactive picture structure data to generate the graphical interactive picture from the relay; a display's graphical interactive picture structure data storage unit for storing the graphical interactive picture structure data received by the graphical interactive picture structure data receipt unit; a manipulation direction signal receipt unit for receiving the manipulation direction signal from the relay; a graphical interactive picture generation unit for retrieving the graphical interactive picture structure data from the display's graphical interactive picture structure data storage unit upon receipt of the manipulation direction signal received by the manipulation direction signal receipt unit to generate the graphical interactive picture by combining the graphical display elements stored in the graphical display element storage unit based on the retrieved graphical interactive picture structure data, and for updating the graphical interactive picture each time the manipulation direction signal receipt unit receives a manipulation direction signal; and a display unit for displaying the graphical interactive picture generated by the graphical interactive picture generation unit.

The fifth object also can be fulfilled by a system comprising a relay, a remote controller, and a display unit, the relay being a peripheral appliance for transferring an action direction signal from the remote controller to the display unit, the relay's function being set by the remote controller, the display unit displaying a graphical interactive picture upon receipt of the signal from the relay, (1) the remote controller including: a first manipulation unit for accepting an action direction addressed to the remote controller; a first control unit for controlling the remote controller to set a function by giving a direction to transmit graphical interactive picture structure data to the relay and generating a manipulation direction signal to generate a graphical interactive picture and to update the graphical interactive picture; and a first manipulation direction signal transmission unit for transmitting the manipulation direction signal generated by the first control unit to the relay, (2) the relay including: a second manipulation unit for accepting an action direction addressed to the relay; a user's graphical interactive picture structure data storage unit for storing the graphical interactive picture structure data in advance to display the graphical interactive picture as per action direction addressed to the relay; a first graphical interactive picture structure data storage unit for storing in advance the graphical interactive picture structure data to display the graphical interactive picture as per graphical-interactive-picture-structure data transmission direction from the remote controller; a second control unit for controlling the relay to set a function upon receipt of the action direction from the second manipulation unit by giving a direction to transmit the graphical interactive picture structure data and generating a manipulation direction signal to generate the graphical interactive picture and to update the graphical interactive picture; a graphical interactive picture structure data transmission unit for retrieving the graphical interactive picture structure data from the user's graphical interactive picture structure data storage unit and the first graphical interactive picture structure data storage unit upon receipt of the transmission direction from the second control unit and the remote controller respectively to transmit the same to the display unit; a second manipulation direction signal transmission unit for transmitting the manipulation direction signal generated by the second control unit to the display unit; and a signal relay unit for receiving the manipulation direction signal received by the remote control unit to transmit the same to the display unit, (3) the display unit including: a graphical display element storage unit for storing a plurality of graphical display elements to generate the graphical interactive picture; a graphical interactive picture structure data receipt unit for receiving the graphical interactive picture structure data to generate the graphical interactive picture from the relay; a display's graphical interactive picture structure data storage unit for storing the graphical interactive picture structure data received by the graphical interactive picture structure data receipt unit; a manipulation direction signal receipt unit for receiving the manipulation direction signal from the relay; a graphical interactive picture generation unit for retrieving the graphical interactive picture structure data from the display's graphical interactive picture structure data storage unit upon receipt of the manipulation direction signal received by the manipulation direction signal receipt unit to generate the graphical interactive picture by combining the graphical display elements stored in the graphical display elements based on the manipulation direction, and for updating the graphical interactive picture each time the manipulation direction signal receipt unit receives a manipulation direction signal; and a display unit for displaying the graphical interactive picture generated by the graphical interactive picture generation unit.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other objects, advantages and features of the invention will become apparent from the following description thereof taken in conjunction with the accompanying drawings which illustrate specific embodiments of the invention. In the drawings:

FIG. 1 is a view depicting a structure of a conventional program receiver apparatus;

FIG. 2 is a view depicting a structure of a remote controller in accordance with a first embodiment of the present invention;

FIG. 3 is a front view of a remote controller unit in the remote controller;

FIG. 4 is an outer perspective view of a remote controller structure information supply unit furnished for the remote controller;

FIG. 5 is an outer perspective view of the remote controller unit and remote controller structure information supply unit furnished for the remote controller;

FIG. 6 is a flowchart detailing the operation of the remote controller in the first embodiment;

FIG. 7 is a view depicting a structure of a remote controller in accordance with the second embodiment of the present invention;

FIG. 8 is a front view of a remote controller unit in the remote controller in the second embodiment;

FIG. 9 is a flowchart detailing the operation of the remote controller in the second embodiment;

FIG. 10 is another flowchart detailing the operation of the remote controller in the second embodiment;

FIG. 11 is a view depicting a structure of a remote controller in accordance with a third embodiment of the present invention;

FIG. 12 is a front view of a remote controller unit in the remote controller in the third embodiment;

FIG. 13 is another front view of the remote controller unit in the remote controller in the third embodiment;

FIG. 14 is another front view of the remote controller unit in the remote controller in the third embodiment;

FIG. 15 is a flowchart detailing the Operation of the remote controller in the third embodiment;

FIG. 16 is another flowchart detailing the operation of the remote controller in the third embodiment;

FIG. 17 is a front view of a modified remote controller unit in the third embodiment;

FIG. 18 is a view depicting a structure of a remote controller in accordance with a fourth embodiment;

FIG. 19 is a front view of a first remote controller unit in the remote controller in the fourth embodiment;

FIG. 20 is a front view of a second remote controller unit in the remote controller in the fourth embodiment;

FIG. 21 is an outer perspective view of the first and second remote controller units in the remote controller in the fourth embodiment;

FIG. 22 is another front view of the second remote controller unit in the remote controller in the fourth embodiment;

FIG. 23 is a flowchart detailing the operation of the remote controller in the fourth embodiment;

FIG. 24 is a view depicting a structure of a remote controller in accordance with a fifth embodiment of the present invention;

FIG. 25 is a front view of a remote controller unit in the remote controller in the fifth embodiment;

FIG. 26 is another front view of the remote controller unit in the remote controller in the fifth embodiment;

FIG. 27 is a flowchart detailing the operation of the remote controller in the fifth embodiment;

FIG. 28 is another front view of the remote controller unit in the remote controller in the fifth embodiment;

FIG. 29 is another front view of the remote controller unit in the remote controller in the fifth embodiment;

FIG. 30 is another front view of the remote controller unit in the remote controller in the fifth embodiment;

FIG. 31 is another front view of the remote controller unit in the remote controller in the fifth embodiment;

FIG. 32 is a view depicting a structure of a menu synthesis apparatus in accordance with a sixth embodiment of the present invention;

FIGS. 33A and 33B are views showing examples of first menu information stored in a first menu storage unit in the sixth embodiment;

FIG. 34 is an example of a menu display on TV in the sixth embodiment;

FIG. 35 is a view showing a part of synthesis rules stored in a synthesis rule storage unit in the sixth embodiment;

FIG. 36 is a view showing an example of second menu information stored in a second menu storage unit in the sixth embodiment;

FIGS. 37A through 37C are views showing examples of menu information synthesized by a menu synthesis unit in the sixth embodiment;

FIG. 38 is a view showing an example of a synthesized menu display in the sixth embodiment;

FIG. 39 is a view showing an example of a video menu in the sixth embodiment;

FIG. 40 is a view showing an example of menu information for the table of contents of a video stored in the second menu storage unit in the sixth embodiment;

FIGS. 41A through 41C are views showing other examples of the menu information synthesized by the menu synthesis unit in the sixth embodiment;

FIG. 42 is a view showing another example of a synthesized menu display in the sixth embodiment;

FIGS. 43A and 43B are flowcharts detailing the operation of the menu synthesis apparatus in the sixth embodiment;

FIG. 44 is a view showing a structure of a remote controller in accordance with a seventh embodiment of the present invention;

FIG. 45 is a view showing an example of the menu information for an air conditioner in the seventh embodiment;

FIGS. 46A through 46C are views showing examples of menu information synthesized by a menu synthesis unit in the seventh embodiment;

FIG. 47 is a view showing an example of a synthesized menu display;

FIG. 48 is a flowchart detailing the operation of the remote controller in the seventh embodiment;

FIG. 49 is a view showing an example of a display in the seventh embodiment;

FIG. 50 is a view depicting a structure of a program transmitter and a program receiver in accordance with an eighth embodiment of the present invention;

FIG. 51 is a view explaining a panel shape 1 in the eighth embodiment;

FIG. 52 is a view explaining box shapes 1, 2, and 3 in the eighth embodiment;

FIG. 53 is a view explaining button shapes 1, 2, and 3 in the eighth embodiment;

FIG. 54 is a view explaining class attribute information in the eighth embodiment;

FIG. 55 is a view explaining panel information in the eighth embodiment;

FIG. 56 is a view explaining box information in the eighth embodiment;

FIG. 57 is a view explaining button information in the eighth embodiment;

FIG. 58 is a view explaining action information in the eighth embodiment;

FIG. 59 is a view explaining display candidate information in the eighth embodiment;

FIG. 60 is a view explaining shape information in the eighth embodiment;

FIGS. 61A through 61C are views explaining display examples of an object (box) in the eighth embodiment;

FIGS. 62A and 62B are views explaining display examples of an object (button) in the eighth embodiment;

FIG. 63 is a view explaining an example of an interactive screen in the eighth embodiment;

FIG. 64 is a view explaining another example of the interactive screen in the eighth embodiment;

FIG. 65 is a view explaining a remote controller in the eighth embodiment;

FIG. 66 is a view explaining how the interactive screen is switched in the eighth embodiment;

FIG. 67 is another view explaining how the interactive screen is switched in the eighth embodiment;

FIG. 68 is another view explaining how the interactive screen is switched in the eighth embodiment;

FIG. 69 is another view explaining how the interactive screen is switched in the eighth embodiment;

FIG. 70 is a flowchart detailing the operation of the program transmitter and program receiver in the eighth embodiment;

FIG. 71 is a flowchart detailing how the interactive screen is generated in the eighth embodiment;

FIG. 72 is another flowchart detailing how the interactive screen is generated in the eight embodiment;

FIG. 73 is another flowchart detailing how the interactive screen is generated in the eight embodiment;

FIG. 74 is another flowchart detailing how the interactive screen is generated in the eight embodiment;

FIG. 75 is a flowchart detailing an interactive operation using the interactive screen in the eighth embodiment;

FIG. 76 is a view showing a structure of a program transmitter and a program receiver in accordance with a ninth embodiment of the present invention;

FIG. 77 is a view explaining object information containing a synthesis instruction in the ninth embodiment;

FIG. 78 is a view explaining actinon information containing a synthesis instruction in the ninth embodiment;

FIG. 79 is a view explaining shape information containing a synthesis instruction in the ninth embodiment;

FIG. 80 is a view explaining display candidate information containing a synthesis instruction in the ninth embodiment;

FIG. 81 is a view explaining synthesized panel information in the ninth embodiment;

FIG. 82 is a view explaining synthesized box information in the ninth embodiment;

FIG. 83 is a view explaining the action information in the ninth embodiment;

FIG. 84 is a view explaining the synthesized action information in the ninth embodiment;

FIG. 85 is a view explaining the synthesized shape information in the ninth embodiment;

FIG. 86 is a view explaining the synthesized display candidate information in the ninth embodiment;

FIG. 87 is a view explaining the class attribute information in the ninth embodiment;

FIG. 88 is a view explaining the panel information in the ninth embodiment;

FIG. 89 is a view explaining the text information in the ninth embodiment;

FIG. 90 is a view explaining the button information in the ninth embodiment;

FIG. 91 is a view explaining the action information in the ninth embodiment;

FIG. 92 is a view explaining the shape information in the ninth embodiment;

FIG. 93 is a view explaining an example of the interactive screen in the ninth embodiment;

FIG. 94 is a view exhaling synthesis instruction information in the ninth embodiment;

FIG. 95 is a view explaining the panel information in the ninth embodiment;

FIG. 96 is a view explaining the text information in the ninth embodiment;

FIG. 97 is a view explaining the button information in the ninth embodiment;

FIG. 98 is a view explaining the action information in the ninth embodiment;

FIG. 99 is a view explaining the shape information in the ninth embodiment;

FIG. 100 is a view explaining the action information in the ninth embodiment;

FIG. 101 is view explaining a synthesized interactive screen in the ninth embodiment;

FIG. 102 is a view explaining an interactive screen switched by remote control in the ninth embodiment;

FIG. 103 is a flowchart detailing the program transmitter and program receiver in the ninth embodiment;

FIG. 104 is a flowchart detailing a synthesis operation for interactive screen structure specification data in the ninth embodiment;

FIG. 105 is a flowchart detailing an interactive operation with the interactive screen in the ninth embodiment;

FIG. 106 is a view depicting a graphical interactive instruction display unit in accordance with a tenth embodiment of the present invention;

FIG. 107 is a view showing a hierarchical correlation within classes in the tenth embodiment;

FIG. 108 shows a definition of the class in the tenth embodiment;

FIG. 109 shows a first definition of an action of an object in the tenth embodiment;

FIG. 110 shows a second definition of the action of the object in the tenth embodiment;

FIG. 111 shows a third definition of the action of the object in the tenth embodiment;

FIG. 112 shows a fourth definition of the action of the object in the tenth embodiment;

FIG. 113 shows a definition of a shape in the tenth embodiment;

FIG. 114 shows a definition of a set value for a button in the tenth embodiment;

FIG. 115 shows a definition of a candidate value in a set box in the tenth embodiment;

FIG. 116 shows a definition of a set value in the set box in the tenth embodiment;

FIG. 117 shows a definition of an object belonging to a panel class in the tenth embodiment;

FIG. 118 is a view showing a structure of a graphical display element stored in a graphical display element storage unit in the tenth embodiment;

FIG. 119 is a view showing an example of a tuner setting panel displayed on a graphical display unit in the tenth embodiment;

FIG. 120 is another view showing an example of the tuner setting panel displayed on the graphical display unit in the tenth embodiment;

FIG. 121 is another view showing an example of the tuner setting panel displayed on the graphical display unit in the tenth embodiment;

FIG. 122 is another view showing an example of the tuner setting panel displayed on the graphical display unit in the tenth embodiment;

FIG. 123 is a first flowchart detailing the operation of the graphical interactive instruction display unit in the tenth embodiment;

FIG. 124 is a second flowchart detailing the operation of the graphical interactive instruction display unit in the tenth embodiment;

FIG. 125 is a view depicting a structure of a graphical interactive instruction display unit in accordance with an eleventh embodiment of the present invention;

FIG. 126 shows a first definition of graphical interactive screen structure data in the eleventh embodiment;

FIG. 127 shows a second definition of graphical interactive screen structure data in the eleventh embodiment;

FIG. 128 is a third definition of graphical interactive screen structure data in the eleventh embodiment;

FIG. 129 is a fourth definition of graphical interactive screen structure data in the eleventh embodiment;

FIG. 130 is a view showing an example of subsidiary data in the eleventh embodiment;

FIG. 131 is a view showing an example of an adjustment panel display on a graphical display unit in the eleventh embodiment;

FIG. 132 is a view depicting a structure of a graphical interactive screen display unit in accordance with a twelfth embodiment of the present invention;

FIG. 133 is a view depicting a structure of a graphical interactive screen display unit in a graphical interactive screen display direction unit in accordance with a thirteenth embodiment of the present invention;

FIG. 134 is a view showing an example of a remote-controller-set-panel display on a graphical display unit in the thirteenth embodiment;

FIG. 135 is a view depicting a structure of a modified graphical interactive screen instruction display unit in the thirteenth embodiment;

FIG. 136 is a view showing a structure of a graphical interactive screen display unit in a graphical interactive screen display direction unit in accordance with a fourteenth embodiment of the present invention;

FIG. 137 is a view depicting a structure of a modified graphical interactive screen display unit in the fourteenth embodiment; and

FIG. 138 is a view depicting the structure of a menu information synthesis apparatus in accordance with the fifteenth embodiment of the present invention;

FIG. 139 is another view depicting the structure of a menu information synthesis apparatus in the fifteenth embodiment;

FIG. 140 is a class definition explaining the content of menu structure data in a TV menu structure data storage element and VTR menu structure data storage element in the fifteenth embodiment;

FIG. 141 is a panel structure definition explaining the content of the menu structure data in the TV menu structure data storage element in the fifteenth embodiment;

FIG. 142 is a button structure definition explaining the content of the menu structure data in the TV menu structure data storage element in the fifteenth the embodiment;

FIG. 143 is a shape definition explaining the content of the menu structure data in the TV menu structure data storage element in the fifteenth embodiment;

FIG. 144 is an action definition explaining the content of the menu structure data in the TV menu structure data storage element in the fifteenth the embodiment;

FIG. 145 is a view showing the content of the element display data stored in a TV display element storage element in the fifteenth embodiment;

FIG. 146 is a view showing the content of synthesis direction data stored in a TV synthesis direction data storage element in the fifteenth embodiment;

FIG. 147 is a view showing a hierarchical correlation between the objects' classes in the fifteenth embodiment;

FIG. 148 is a panel structure definition explaining the content of the menu structure data in the VTR menu structure data storage element in the fifteenth embodiment;

FIG. 149 is a button structure definition explaining the content of the menu structure data in the VTR menu structure data storage element in the fifteenth the embodiment;

FIG. 150 is a shape definition explaining the content of the menu structure data in the VTR menu structure data storage element in the fifteenth the embodiment;

FIG. 151 is an action definition explaining the content of the menu structure data in the VTR menu structure data storage element in the fifteenth the embodiment;

FIG. 152 is a view showing the content of the element display data stored in a VTR display element storage element in the fifteenth embodiment;

FIG. 153 is a view showing the content of synthesis direction data stored in a VTR synthesis direction data storage element in the fifteenth embodiment;

FIG. 154 is a view showing the content of the menu structure data when top panels shown in FIGS. 141 and 151 are simply combined in the fifteenth embodiment;

FIG. 155 is a view showing the content of the menu structure data when the top panels are synthesized by SIMPLE COMBINE in the fifteenth embodiment;

FIG. 156 is a view showing the content of the menu structure data during a top-panel synthesis process by UNIQ COMBINE in the fifteenth embodiment;

FIG. 157 is a view showing the content of the menu structure data when the top panels are synthesized by UNIQ COMBINE in the fifteenth embodiment;

FIG. 158 is a view showing the menu structure data when set panels are simply combined in the fifteenth embodiment;

FIG. 159 is a view showing the content of the menu structure data when the set panels are synthesized by SIMPLE COMBINE in the fifteenth embodiment;

FIG. 160 is a view showing the content of the menu structure data when the set panels are synthesized by UNIQ combine in the fifteenth embodiment;

FIG. 161 is a view showing the content of post-synthesis shape data in the fifteenth embodiment;

FIG. 162 is a view showing an example of a display of the TV menu structure data in the fifteenth embodiment;

FIG. 163 is a view showing an example of a display of the VTR menu structure data in the fifteenth embodiment;

FIG. 164 is a view showing an example of a display of a top panel after synthesizing the TV menu information and VTR menu information in the fifteenth embodiment;

FIG. 165 is a view showing an example of a display of a set panel after synthesizing the TV menu information and VTR menu information in the fifteenth embodiment;

FIG. 166 is a flowchart detailing the operation related to the fifteenth embodiment;

FIG. 167 is another flowchart detailing the operation related to the fifteenth embodiment; and

FIG. 168 is another flowchart detailing the operation related to the fifteenth embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Fifteen embodiments of the present invention will be explained while referring to the drawing.

FIRST EMBODIMENT

FIG. 2 is a view depicting a structure of a remote controller in accordance with the first embodiment. The remote controller includes a remote-control-structure (RM-structure) information supply unit 201 and a remote control (RM) unit 202. Note that appliances placed under the control of the remote controller (hereinafter referred to simply as the appliances) are not shown in the drawing, and for the explanation's convenience, let the appliances be various types of TVs made by a plurality of makers. The RM-structure information supply unit 201 includes a RM-structure information storage unit 203, a RM-structure information transmission unit 204, a structure-information-transmission direction unit 205. The RM unit 202 includes a structure information receipt unit 206, a structure information storage unit 207, a manipulation unit 208, and a RM signal transmission unit 209. Note that the remote controller referred in the first through fifth embodiments includes a signal (ultra-red-ray) transmitter manipulated by the user and a controller for controlling the appliances as per transmitted signals, and that the RM unit referred herein includes only the signal transmitter.

More precisely, the RM-structure information supply unit 201 holds the information necessary for the RM unit 202 to control the appliances, and transmits the information to the RM unit 202 via a transmission path, or namely the ultra red rays.

The RM unit 202 is manipulated by the user.

The RM-structure information storage unit 203 is a ROM (Read Only Memory) and stores RM-structure information, which is in effect control signals transmitted from the RM unit 202 to the appliances. In this embodiment, the control signals corresponding to a button group 301 (FIG. 3) on the RM unit 202 for each type of TVs are stored, so that the RM signal transmission unit 209 transmits an adequate control signal when a button is pushed. The RM-structure information transmission unit 204 selectively retrieves the RM-structure information from the RM-structure information storage unit 203 as per direction from the structure-information-transmission direction unit 205 to transmit the same to the RM unit 202.

The structure-information-transmission direction unit 205 directs the RM-structure information transmission unit 204 to transmit the RM-structure information from the RM-structure information storage unit 203.

The structure information receipt unit 206 receives the RM-structure information from the RM-structure information transmission unit 204 to have the structure information storage unit 207 store the same.

The structure information storage unit 207 stores the RM-structure information received by the structure information receipt unit 206.

The manipulation unit 208 is manipulated by the user to control the appliances.

The RM signal transmission unit 209 retrieves the control signals, or the RM-structure information, from the structure information storage unit 207 in accordance with manipulation signals from the manipulation unit 208.

FIG. 3 is a front view of the RM unit 202, which is enclosed in a case, so that the user can easily hold it in hand when manipulating the same. Placed on the front surface of the RM unit 202 is the button group 301 including a power ON/OFF button, channel buttons, and volume buttons; the button group 301 forms the manipulation unit 208.

FIG. 4 is an outer perspective view of the RM-structure information supply unit 201, which is enclosed in a box. Placed on the front surface of the RM-structure information supply unit 201 are a toggle 401 and an emitter 402. The toggle 401 is rotated to select the type of the appliances, to which the RM-structure information transmission unit 204 transmits the control signal from the RM-structure information storage unit 203, and it forms a part of the structure-information-transmission direction unit 205. The emitter 402 emits the ultra red rays as the control signals from the RM-structure information storage unit 203, and it forms a part of the RM-structure information transmission unit 204.

The RM-structure information is transmitted from the RM-structure information storage unit 203 to the RM unit 202 by rotating the toggle 401 while placing the RM unit 202 in an opposing position to the emitter 402 as shown in FIG. 5.

The operation related to this embodiment will be explained while referring to the flowchart in FIG. 6.

The user places the RM unit 202 in an opposing position to the emitter 402 of the RM-structure information supply unit 201, and rotates the toggle 401 of the RM-structure information supply unit 201. Then, the structure-information-transmission direction unit 205 directs the RM-structure information transmission unit 204 to transmit the control signal for the TV specified by the toggle 401 from the RM-structure information storage unit 202 (S602). Subsequently, the RM-structure information transmission unit 204 transmits the adequate control signal for the specified type of TV to the RM unit 202 (S604), and the structure information receipt unit 206 receives the control signal from the RM-structure information transmission unit 204 (S606). Accordingly, the structure information storage unit 207 stores the control signal received by the structure information receipt unit 206 (S608). Having stored the control signal for the specified type of TV into the structure information storage unit 207, the RM unit 202 becomes able to control the specified type of TV.

According to the above structure, the structure information storage unit 207 does not have to store the control signals for all kinds of appliances in advance; it can obtain the adequate control signal for a specified type of appliance when necessary. Moreover, a new type of appliance can be placed under the control relatively easy.

In addition, a plurality of RM units 202 can be made for one RM-structure information supply unit 201, and each can receive the control signals for any desired appliances from an automatic information providing unit installed in the RM-structure information supply unit 201.

In this embodiment, the RM-structure information in the RM-structure information storage unit 203 are the control signals; however, it may be, for example, the information as to the appearance (color, design, etc.) or the button arrangement.

Although the appliances are the different types of TVs in this embodiment, they may be the VTRs or air conditioners. In this case, the RM-structure information storage unit 203 stores the control signals for these appliances, and the appearance of the RM unit 202 is modified accordingly.

Further, the RM-structure information storage unit 203 may store the control signals for a plurality of types of appliances in various kinds (TVs, VTRs, and air conditioners made by a plurality of makers).

The ultra red rays are used as the transmission path between the RM-structure information transmission unit 204 and structure information receipt unit 206; however, other transmission media such as radios or cables may be used as well.

The RM unit 202 may additionally include a lamp to indicate that it has stored the RM-structure information correctly. Further, the RM unit 202 may include a means to notify the user when the RM-structure information does not match with the button group 301 of the RM unit 202.

SECOND EMBODIMENT

FIG. 7 is a view depicting the structure of a remote controller in accordance with the second embodiment of the present invention. The remote controller comprises a RM-structure information supply unit 701 and a RM unit 702. Note that the RM-structure information supply unit 701 is installed in an appliance 703.

The RM-structure information supply unit 701 includes a RM-structure information storage unit 704, a RM-structure information transmission unit 705, and a structure-information request receipt unit 706. The RM Unit 702 includes a structure information receipt unit 707, a structure information storage unit 708, a manipulation unit 709, a RM signal transmission unit 710, and a structure-information request transmission unit 711.

The appliance 703 includes a RM signal receipt unit 712 and an appliance control unit 713.

More precisely, the RM-structure information supply unit 701 holds the information necessary for the RM unit 702 to control the appliance 703, and transmits the information to the RM unit 702 via a transmission path, or namely the ultra red rays. The RM unit 702 is manipulated by the user of the appliance 703. The appliance 703 is under the control of the RM unit 702.

The RM-structure information storage unit 704 stores RM-structure information, which is in effect the control signals transmitted from the RM unit 702 when controlling the appliance 703. In this embodiment, the control signals for all types of TVs are stored, so that the RM signal transmission unit 710 transmits an adequate control signal when a buttons of a button group 801 is pushed.

The RM-structure information transmission unit 705 transmits the RM-structure information to the RM unit 702 from the RM-structure information storage unit 704.

The structure-information request receipt unit 706 receives a RM-structure information request from the structure-information request transmission unit 711, and in response gives a direction to the RM-structure information transmission unit 705 to transmit the RM-structure information from the RM-structure information storage unit 704. The structure information receipt unit 707 receives the RM-structure information from the RM-structure information transmission unit 705. The structure information storage unit 708 stores the RM-structure information received by the structure information receipt unit 707. The manipulation unit 709 is manipulated by the user to control the appliance 703. The RM signal transmission unit 710 retrieves the control signal from the structure information storage unit 708 in accordance with a manipulation signal from the manipulation unit 709, and transmits the same to the appliance 703. The structure-information request transmission unit 711 transmits a signal requesting the transmission of the RM-structure information necessary for the RM unit 702 to control the appliance 703. The RM signal receipt unit 712 receives the control signal from the RM signal transmission unit 710. The appliance control unit 713 activates the appliance 703 as per control signal received by the RM signal receipt unit 712.

FIG. 8 is a front view of the RM unit 702, which is enclosed in a case, so that the user can hold it easily in hand when manipulating the same to control the appliance 703. Placed on the front surface of the RM unit 702 is the button group 801 and a set button 802. The former includes a plurality of the buttons to control the appliance 703 such as a power ON/OFF button, channel buttons, and volume buttons, and it forms a part of the manipulation unit 709. The latter is used to transmit a request to the RM-structure information supply unit 701 to transmit the control signal for the appliance 703 to the RM unit 702, and it forms a part of the structure-information request transmission unit 711.

The operation related to this embodiment will be explained while referring to the flowcharts in FIGS. 9 and 10. The transmission paths in the form of the ultra red ray signals are secured between the structure-information request receipt unit 706 and structure-information request transmission unit 711, the RM-structure information transmission unit 705 and structure information receipt unit 707, and the RM signal transmission unit 710 and RM signal receipt unit 712, respectively. More precisely, a ultra red ray signal transmitter is furnished in the RM unit 702 while a ultra red ray signal receiver is furnished in the appliance 703, and the transmission path is formed when these two units are placed in an opposing position.

To begin with, the user pushes the set button 802, then the structure-information request transmission unit 711 transmits a request to the RM-structure information supply unit 701 to transmit the control signal to the RM unit 702 (S902). Accordingly, the structure-information request receipt unit 706 receives the request from the structure-information request transmission unit 711, and gives a direction to the RM-structure information transmission unit 705 to transmit the control signal to the RM unit 702 from the RM-structure information storage unit 704 (S904). Subsequently, the RM-structure information transmission unit 705 transmits the control signal to the RM unit 702 from the RM-structure information storage unit 704 (S906), and the structure information receipt unit 707 receives the control signal from the RM-structure information transmission unit 705 (S908). Accordingly, the structure information storage unit 703 stores the control signal received by the structure information receipt unit 707 (S910). Having stored the control signal in the structure information storage unit 708 in this way, the RM unit 702 becomes able to control the appliance 703.

Further, the appliance 703 is controlled as follows. To begin with, the user pushes one of the buttons of the button group 801, then the manipulation unit 709 gives a direction to the RM signal transmission unit 710 to transmit the corresponding control signal (S1002). Accordingly, the RM signal transmission unit 710 transmits the control signal from the structure information storage unit 708 as per direction from the manipulation unit 709 to the appliance 703 (S1004), and the RM signal transmission unit 712 receives the control signal from the RM unit 702 (S1006). Then, the appliance control unit 713 activates and controls the appliance 703 as per control signal received by the RM signal reception unit 712 (S1008).

According to the above structure, the structure information storage unit 708 does not have to store the control signals for all the appliances in advance, and instead, receives the adequate control signal for the appliance 703 when necessary.

Unlike the first embodiment, the RM-structure information supply unit 701 is installed in the appliance 703, and thus the user neither has to specify the appliance nor direct the transmission of the RM-structure information, further facilitating the manipulation.

Although the appliances are various types of TVs made by a plurality makers in this embodiment, they may be the VTRs or air conditioners. In this case, the RM-structure information storage unit 704 stores the control signals for these appliances, and the appearance of the RM unit 702 is modified accordingly.

Further, the RM unit 702 may include a button group for controlling the TV and VTR, and the structure information storage unit 708 in the RM unit 702 may accordingly store the control signals for both the appliances.

The RM-structure information request is transmitted to the RM-structure information supply unit 701 by the pushing of the set button in the RM unit 702 by the user. However, signals may be transmitted at regular intervals from either the appliance 703 or RM unit 702, and the RM-structure information may be automatically transmitted upon detection of the signal.

Although ultra red ray signals are used as the transmission paths in this embodiment, other transmission media such as radios or cables are used as well. In particular, the RM-structure information may be transferred by means of a flexible disk between the RM-structure transmission unit 705 and structure information receipt unit 707 by installing flexible disk drives to the RM-structure information supply unit 701 and RM unit 702. Also, the RM unit 702 may additionally include a lamp to indicate that it has stored the RM-structure information correctly. Further, the RM unit 702 may include a means to notify the user when the RM-structure information does not match with the button group 801 of the RM unit 702.

THIRD EMBODIMENT

FIG. 11 is a view depicting the structure of a remote controller in accordance with the third embodiment of the present invention. The remote controller comprises a RM-structure information supply unit 1101 and a RM unit 1102; the RM-structure information supply unit 1101 is installed in an appliance 1103.

The RM-structure information supply unit 1101 includes a RM-structure information storage unit 1104, a RM-structure information transmission unit 1105, and a structure-information request receipt unit 1106. The RM 1102 includes a structure information receipt unit 1107, a structure information storage unit 1108, a manipulation unit 1109, a RM signal transmission unit 1110, a structure-information request transmission unit 1111, and a manipulation display unit 1112. The structure information storage unit 1108 includes a RM signal storage unit 1113 and a display information storage unit 1114. The appliance 1103 includes an appliance control unit 1115 and a RM signal receipt unit 1116.

The RM-structure information supply unit 1101 holds the information necessary for the RM unit 1102 to control the appliance 1103 and transmits the information to the RM unit 1102 via a transmission path. The RM unit 1102 is manipulated by the user of the appliance 1103. The appliance 1103 is under the control of the RM unit 1102. The RM-structure information storage unit 1104 stores RM-structure information, which is in effect a control signal transmitted from the RM unit 1102 in controlling the appliance 1103. The RM-structure information transmission unit 1105 transmits the RM-structure information to the RM unit 1102 from the RM-structure information storage unit 1104. The structure-information request receipt unit 1106 receives a RM-structure-information request from the structure-information request transmission unit 1111, and in response directs the RM-structure information transmission unit 1105 to transmit the RM-structure information from the RM-structure information storage unit 1104. The structure information receipt unit 1107 receives the RM-structure information from the RM-structure information transmission unit 1105. The structure information storage unit 1108 stores the RM-structure information received by the structure information receipt unit 1107. The manipulation unit 1109 is used to manipulate the user to control the appliance 1103. The RM signal transmission unit 1110 retrieves the control signal from the RM signal storage unit 1113 as per manipulation signal from the manipulation unit 1109, and transmits the same to the appliance 1103. The structure-information request transmission unit 1111 transmits a signal requesting the RM-structure information necessary for the RM unit 1102 to control the appliance 1103. The manipulation display unit 1112 displays figures such as soft buttons, or objects in a user interface screen. The soft buttons referred herein are not the physical buttons, but the buttons actively displayed on an LC (Liquid Crystal) display at the bottom of an LC touch panel 1201 by an application program, and serve as the physical buttons. The RM signal storage unit 1113 stores the control signal the RM unit 1102 transmits when controlling the appliance 1103. The display information storage unit 1114 stores the data the manipulation display unit 1112 displays. The appliance control unit 1115 activates and controls the appliance 1103 as per control signal received by the RM signal receipt unit 1116. The RM signal receipt unit 1116 receives the control signal transmitted from the RM signal transmission unit 1110.

FIG. 12 is a front view of the RM unit 1102. The RM unit 1102 is inclosed in a case, and is manipulated by the user to control the appliance 1103. Placed on the front surface of the RM 1102 are the LC touch panel 1201 and a set button 1203 as shown in FIG. 13. The LC touch panel 1201 serves as both the LC display and the touch panel and displays a soft button group 1202 for controlling the appliance 1103 such as the TV or VTR. FIG. 12 shows the LC touch panel displaying the soft button group 1202 for controlling the VTR, while FIG. 14 shows the LC touch panel 1201 displaying a soft button group 1401 for controlling the TV. The touch panel of the LC touch panel 1201 forms a part of the manipulation unit 1109, and the display of the LC touch panel 1201 forms a part of the manipulation display 1112. The set button 1203 is used to transmit a request to the RM-structure information supply unit 1101 in the appliance 1103 to transmit the control signal for the appliance 1103 and the information related to the soft button group 1202 to be displayed on the LC touch panel 1201. The set button 1203 forms a part of the structure-information request transmission unit 1111. Note that the RM-structure information storage unit 1104 stores the information related to the soft button group 1202 in relation with the control signals the RM signal transmission unit 1110 transmits when a soft button of the soft button group 1202 is pushed.

Next, the operation related to this embodiment will be explained while referring to the flowcharts in FIGS. 15 and 16.

Assume that the LC touch panel 1201 displays nothing as shown in FIG. 13. Then, when the user pushes the set button 1203, the structure-information request transmission unit 1111 transmits a request to the structure-information request receipt unit 1106 to transmit the RM-structure information to the RM unit 1102 (S1502). Upon receipt of the transmission request from the structure-information request transmission unit 1111, the structure-information request receipt unit 1106 directs the RM-structure information transmission unit 1105 to transmit the information related to the soft button group 1202 and control signal from the RM-structure information storage unit 1104 (S1504). Subsequently, the RM-structure information transmission unit 1105 transmits the information related to the soft button group 1202 and the control signal to the RM unit 1102 (S1506), and the structure information receipt unit 1107 receives the same (S1508). Accordingly, the RM signal storage unit 1113 stores the control signal while the display information storage unit 1114 stores the information related to the soft button group 1202 (S1510). Then, the manipulation display unit 1112 displays the soft button group 1202 as shown in FIG. 12 on the LC touch panel 1201 using the information stored in the display information storage unit 114 (S1512). In this way, the RM unit 1102 stores the control signal for the appliance 1103 into the RM signal storage unit 1113, and stores the information related to the soft button group 1202 in the display information storage unit 1114, and becomes able to control the appliance 1103. Note that each soft button of the soft button group 1202 on the LC touch panel 1201 corresponds to the individual control signals stored in the RM signal storage unit 1113.

Next, when the user selectively pushes a soft button of the soft button group 1202, the manipulation unit 1109 directs the RM signal transmission unit 1110 to transmit the control signal (S1602). Thus, the RM signal transmission unit 1110 transmits the control signal to the appliance 1103 from the RM signal storage unit 1113 as per direction from the manipulation unit 1109 (S1604), and the RM signal receipt unit 1116 receives the control signal from the RM unit 1102 (S1606). Accordingly, the appliance control unit 1115 controls and activates the appliance as per control signal received by the RM signal receipt unit 1116 (S1608).

If the appliance 1103 is the TV, the remote controller operates in the same manner as above; however, the LC touch panel 1201 displays the soft button group 1401 as shown in FIG. 14 for controlling the TV, and the control signals assigned to each soft button in the soft button group 1401 are stored in the RM unit 1102.

According to the above construction, the RM unit 1102 has to store neither the control signal for the appliance 1103 nor the user interface such as the control buttons in advance, and instead, it stores the adequate control signal and user interface screen for a desired appliance when necessary. When the conventional remote controller controls a plurality kinds of appliances including the TV, VTR, CD player, and tuner, it must include a plurality of buttons: channel buttons and volume buttons for the TV, playback button, stop button, and record button for the VTR, the play button, track selection button for the CD player, and the tuning button for the tuner, as well as the control signals for each button. The number of the buttons further increases when one kind of appliance includes a plurality of types. However, the remote controller in this embodiment neither has to include these buttons nor store the control signals in advance. Moreover, the remote control can place a new household appliance under the control easily.

In this embodiment, the soft button group 1202 is displayed on the LC touch panel 1201. However, as shown in FIG. 17, a physical button group and the LC display unit may be combined to display the functions of each button on an LC display 1702.

The RM-structure information supply unit 1101 or RM unit 1102 may include a means for specifying attribute of the RM-structure such as "normal", "child", "elder". Thus, if "elder" is specified, larger soft buttons will appear on the LC touch panel 1201 compared with those appearing upon specifying "normal", and if "child" is specified, the soft buttons will appear in a simpler way on the LC touch panel 1201.

Also, the size or position of the objects to be manipulated may be customized by the user with the RM remote controller 1102.

FOURTH EMBODIMENT

FIG. 18 is a view depicting the structure of a remote controller in accordance with the fourth embodiment of the present invention. The remote controller comprises a RM-structure information supply unit 1803 and a second RM unit 1802. The RM-structure information supply unit 1803 is enclosed in a first RM unit 1801, and the appliances are not shown in the drawing.

The RM-structure information supply unit 1803 includes a first structure information storage unit 1804, a structure information transmission unit 1805, and a structure-information request receipt unit 1806. The second RM unit 1802 includes a structure information receipt unit 1807, a second structure information storage unit 1808, and a structure-information request transmission unit 1809.

The first RM unit 1801 controls predetermined appliances, and the second RM unit 1802 is manipulated by the user to control the appliances. The RM-structure information supply unit 1803 holds the information necessary for the second RM unit 1802 to control the appliances and transmits the same to the second RM unit 1802 via a transmission path, or namely ultra red rays. The first structure information storage unit 1804 stores RM-structure information. The RM-structure information referred herein includes the information related to each object to be manipulated such as buttons furnished with the first RM unit 1801, and the control signals assigned for each object that the second RM unit 1802 transmits when the object is manipulated. The structure information transmission unit 1805 transmits the RM-structure information to the second RM unit 1802 from the first structure information storage unit 1804. The structure-information request receipt unit 1806 receives a structure information request from the structure-information request transmission unit 1809, and in response gives a direction to the structure information transmission unit 1805 to transmit the content of the first structure information storage unit 1804 to the second RM unit 1802. The structure information receipt unit 1807 receives the RM-structure information from the structure information transmission unit 1805. The second structure information storage unit 1808 stores the RM-structure information received by the structure information receipt unit 1807. Note that a manipulation means, a RM signal transmission means, and manipulation display means in the second RM unit 1802 are not shown in the drawing.

FIG. 19 is a front view of the first RM unit 1801. Placed on the front surface of the first RM unit 1801 is a button group 1901. The button group 1901 is used to control the TV as an example of the appliance, and it includes a power button, channel buttons, and volume buttons.

FIG. 20 is a front view of the second RM unit 1802. Place on the front surface of the second RM unit 1802 are an LC touch panel 2001 and a set button 2002. The LC touch panel 2001 serves as an output unit (LC display) and also as an input unit (touch panel). The set button 2002 is used to transmit a request to the first RM unit 1801 to transmit the control signal and the information related to the soft button group 1901 to be displayed on the LC touch panel 2001 to the second RM unit 1802. The set button 2002 forms a part of the structure-information request transmission unit 1809.

A soft button group 2201 as shown in FIG. 22 will be displayed on the LC touch panel 2001 by placing the first RM unit 1801 in an opposing position to the second RM unit 1802 and pushing the set button 2002 as shown in FIG. 21.

Next, the operation related to this embodiment will be explained while referring to the flowchart in FIG. 23.

When the user pushes the set button 2002 while placing the first RM unit 1801 in an opposing position to the second RM unit 1802, the RM-structure request transmission unit 1809 transmits a request to the first RM unit 1801 to transmit the control signal and the information related to the soft button group 2201 to be displayed on the LC touch panel 2001 to the second RM unit 1802 (S2302). Upon receipt of the transmission request, the structure-information request receipt unit 1806 gives a direction to the structure information transmission unit 1805 to transmit the control signal and the information related to the soft button group 2201 from the structure information storage unit 1804 (S2304). Accordingly, the structure information transmission unit 1805 retrieves the control signal and the information related to the soft button group 2201 from the first structure information storage unit 1804 and transmits the same to the second RM unit 1802 (S2306). Then, the structure information receipt unit 1807 receives the control signal and the information related to the soft button group 2201 from the structure information transmission unit 1805 (S2308). Accordingly, the second structure information storage unit 1808 stores the control signal and information related to the soft button group 2201 received by the structure information receipt unit 1807 (S2310). In this way, the second RM unit 1802 obtains all the functions the first RM unit 1801 has, and the soft button group 2201 as shown in FIG. 22 is displayed on the LC touch panel 2001.

According to the above structure, the second RM unit 1802 can actively retain the same functions as the first RM unit 1801. For this reason, the second RM unit 1802 does not have to include a plurality of buttons for all the available functions like a conventional self-learning remote controller, which can be customized in a desired manner. Further, the second RM unit 1802 does not have to store the control signals assigned for each button.

In this embodiment, the RM-structure information is transmitted from the first structure information storage unit 1804 when the structure-information request receipt unit 1806 in the first RM unit 1801 receives the transmission request from the structure-information request transmission unit 1809 in the second RM unit 1802. However, a structure-information-transmission direction unit may be installed instead of the structure-information request transmission unit 1809 and structure-information request receipt unit 1806, and a structure-information-receipt direction unit may be installed in the second RM unit 1802, so that the structure information transmission unit 1805 and structure information receipt unit 1807 may be activated as per direction from these units. The directions are transmitted by the pushing of a corresponding button on the first RM unit 1801 and the second RM unit 1802.

FIFTH EMBODIMENT

FIG. 24 is a view depicting the structure of a remote controller in accordance with the fifth embodiment of the present invention. The remote controller comprises a RM-structure information supply unit 2401 and a RM unit 2402; the RM-structure information supply unit 2401 is installed in an appliance 2403.

The RM-structure information supply unit 2401 includes a RM-structure information generation unit 2404, a RM-structure information transmission unit 2405. The RM unit 2402 includes a structure information receipt unit 2406, a structure information storage unit 2407, a manipulation unit 2408, a RM signal transmission unit 2409, and a manipulation display unit 2410. The structure information storage unit 2407 includes a RM signal storage unit 2411 and a display information storage unit 2412. The appliance 2403 includes an appliance control unit 2417 and a RM signal receipt unit 2418.

The RM-structure information supply unit 2401 holds the information necessary for the RM unit 2402 to control the appliance 2403, and transmits the same to the RM unit 2402 via a transmission path, or namely ultra red rays. The RM unit 2402 is manipulated by the user, and the appliance 2403 is controlled by the RM unit 2402.

The RM-structure information generation unit 2404 generates the RM-structure information depending on the state of the appliance 2403; the RM-structure information referred herein is objects to be manipulated such as buttons on the RM unit