FI131330B1

FI131330B1 - Earthmoving machinery control

Info

Publication number: FI131330B1
Application number: FI20176052A
Authority: FI
Inventors: Visa Hokkanen; Mikko Vesanen
Original assignee: Novatron Oy
Priority date: 2017-11-24
Filing date: 2017-11-24
Publication date: 2025-02-24
Also published as: EP3489421A3; EP3489421A2; CN109837940B; FI20176052A1; US20190161941A1; CN109837940A; US11486117B2; FI20180081A1; FI20180082A1

Abstract

The invention is based on the idea of controlling the operations of the earthmoving machine (E) controllable by the operator (5) by using only one to four controllers (CO) and at least one displaying means for displaying controls selectable and controllable by the one to four controllers (CO). The selections and controls of the operations for controlling the earthmoving machine (E) may be transmitted to control unit (CU) both by wire and wirelessly. Thus, the one to four controllers (CO) are operable both attached and detached. Further, the control system (CS) is arranged to determine the loction of the one to four controllers (CO) with respect to the earthmoving machine (E).

Description

CONTROLLING EARTHMOVING MACHINES

FIELD OF THE INVENTION

The invention relates to a control system, an earthmoving machine, a method for controlling an earthmoving machine, a computer program product and a computer program embodied on a non-transitory computer readable stor- age medium for controlling an earthmoving machine.

BACKGROUND OF THE INVENTION

Different types of earthmoving machines may be utilized at different work sites for moving soil or rock material to another location or to process them into a desired shape. Earthmoving machines are used in excavation work and road construction, for example. Earthmoving machines have user interfaces con- taining multiple controllers and multiple displaying means for an operator to in- teract with the earthmoving machine.

BRIEF DESCRIPTION OF THE INVENTION

An object of the present invention is to provide a novel and improved control system for an earthmoving machine. Further object is to provide a novel and improved earthmoving machine equipped with the control system.

The objects of the invention are achieved by what is stated in the inde- pendent claims. Embodiments of the invention are disclosed in the dependent — claims.

The invention is based on the idea of controlling the operations of the earthmoving machine controllable by the operator by using only one to four con- trollers and at least one displaying means for displaying controls selectable and

I controllable by the one to four controllers. The selections and controls of the op-

N 25 erations for controlling the earthmoving machine may be transmitted to control

N unit both by wire and wirelessly. Thus, the one to four controllers are operable = both attached and detached. Further, the control system is arranged to determine

I the location of the one to four controllers with respect to the earthmoving ma- - chine. The at least one displaying means display the operations of the earthmov-

D 30 ing machine selectable and controllable by the one to four controllers to select an 2 operation of the earthmoving machine to control from the displayed operations to > control the selected operation.

An advantage of the control system of the invention is that the opera- tor of the earthmoving machine may customize the way for controlling the opera-

tions of the earthmoving machine with the one to four controllers according to his or her own desires. Another advantage is that the operator need not to reach out any other buttons or switches in any case if desired.

According to an embodiment, the operation mode of the one to four controllers in the disclosed control system depends on whether each of the one to four controllers are attached or detached.

According to an embodiment, the operation mode of each of the one to four controllers, when detached, depends on the distance between these control- lers and the earthmoving machine.

According to an embodiment, the operation mode of each of the one to four controllers, when detached, depends on the distance between these control- lers and the earthmoving tool of the earthmoving machine.

According to an embodiment, the operation mode of each of the one to four controllers, when detached, depends on the distance between each other.

According to an embodiment, the operation mode of each of the one to four controllers depends on the distance between a detected obstacle and the earthmoving tool or the earthmoving machine.

According to an embodiment, the operation mode of the one to four controllers depends on the user specified adjustments made by or made for the user currently logged in to the control system.

According to an embodiment, the extent of the available adjustments depends on the skill level data of the user currently logged in, the skill level data being defined by at least one of: usage hours of the earthmoving machine, usage hours of the respective earthmoving machine, competence level accomplished or passed by an examination or test. < According to an embodiment, the operation of the earthmoving ma-

N chine controllable by the one to four controllers is at least one of: peripheral de- a vice, maintenance system, road navigation system, work site navigation system, i positioning the earthmoving tool with respect to the work site, weighing system,

O 30 automation system, measuring system and process control.

E According to an embodiment, the control system gives feedback by at

N least one of the following signals: graphical, augmented reality, virtual reality, 2 audiovisual, visual illumination, haptics and force-feedback. = According to an embodiment, the user with administrator privileges

N 35 define the skill level by editing the skill level data of the user.

According to an embodiment, the user with administrator privileges define the skill level by editing the skill level data of the user in a cloud service and the earthmoving machine retrieves the data from the cloud service.

According to an embodiment, the at least one control unit is config- ured to receive selections and controls from the one to four controllers for con- trolling at least the tool and the driving of the earthmoving machine.

According to an embodiment, the at least one control unit is config- ured to receive selections and controls from the one to four controllers for con- trolling all the operations of the earthmoving machine controllable by the opera- tor of the earthmoving machine.

According to an embodiment, the amount of controllers is two.

According to an embodiment, the earthmoving machine is one of the following: excavator, bulldozer, motor grader, compaction machine, piling ma- chine, deep stabilization machine, surface top drilling machine.

The above-disclosed embodiments may be combined to form suitable — solutions provided with necessary features disclosed.

BRIEF DESCRIPTION OF THE DRAWINGS

Some embodiments are described in more detail in the accompanying drawings, in which

Figure 1 is a schematic side view of an excavating machine provided with two controllers,

Figure 2 is a schematic view of an operator operating an earthmoving machine outside the cabin,

Figure 3 is a schematic diagram showing some feasible earthmoving machines,

Figures 4a - 4c are schematic side views of some possible arrange-

N ments for displaying earthmoving images on a transparent display unit,

N Figure 5 is a schematic front view of a headset provided with one or = two head-mounted display units, and ™ Figure 6 is a schematic front view of a helmet provided with a head-

E 30 mounted display unit. ~ For the sake of clarity, the figures show some embodiments of the dis-

S closed solution in a simplified manner. In the figures, like reference numerals ~ identify like elements. i

DETAILED DESCRIPTION OF THE INVENTION

Figure 1 shows an earthmoving machine E, which is in this case an ex- cavator comprising a movable carrier 1 on which a boom 2 is arranged. At a distal end of the boom 2 is a tool 3, in this case a bucket. The boom 2 may be moved in a versatile manner. The operator 5 may select the manner how the boom 2 and the bucket responds to the controls of the controllers CO. The user may prefer in some cases semiautomatic controlling, where the bucket moves in a preconfig- ured or preprogrammed manner according to given controls and in the other cas- es the user may prefer more traditional way, for example, by controlling the — bucket such that each joint in the boom 2 and the bucket are controlled separate- ly.

On the carrier 1 is a control cabin 4 for an operator 5. Inside the cabin 4 is a displaying means, which comprises, for example, at least one transparent display unit 6 through which the operator 5 may monitor operation of the tool 3 and display controls selectable and controllable. The display unit 6 may also be some other kind. Additionally, the displaying means, part of the displaying means or the display unit 6 may be wireless or detachable like the controllers CO.

Figure 1 further discloses that the earthmoving machine E and its op- erational components may be equipped with sensors 11 and measuring devices for gathering position data and sense the surroundings and the location of the controllers CO, for example. Moreover, the earthmoving machine E may comprise one or more navigation or position determining systems 12, such as a global navi- gation satellite system (GNSS), for determining position and direction of the earthmoving machine E.

According to an embodiment, skill level, user account or both may at + least one of force, entitle, deny and limit the usage of at least some controls, fea-

S tures or both.

AN According to an embodiment, an experienced operator 5 desires to use i four controllers CO, one for both hands and one for both feet, and the semiauto- 9 30 matic controls where the operator 5 may control the bucket, for example, to go = left, right, forward, backward, up and down. The operator 5 may also select at

N which degree with respect to horizontal or vertical plane the bucket goes to these 3 directions. The controllers CO used by feet he desires to drive the earthmoving = machine E. The other foot may control the speed and whether to go forward or

N 35 backward and the other foot may control whether to go straight or to turn left or right, for example.

The user may select from various alternatives which kind of feedback signals he or she desires at each situation in each earthmoving machine E. Se- lectable feedback signals are at least: graphical, augmented reality, virtual reality, audiovisual, visual illumination, haptics and force-feedback. 5 Automatic or semiautomatic controls, as well as any other data relat- ing to earthmoving machine E, may be preprogrammed into the control unit CU.

New automatic and semiautomatic controls may be programmed by the operator 5 or the operator 5 may download preprogrammed or preconfigured automatic or semiautomatic controls, for example as a data packet, from a cloud service — where the earthmoving machine E or the user has access to. The user may, for example, log into his or her user account or identify himself or herself using any known method into the earthmoving machine E or into the cloud service or the user may log or identify the earthmoving machine E into the cloud service and select the data packets he or she desires and has access to and download them. — Data packets may be downloaded in every other known way, as well. Preferably, a user with administrator privileges may download the data packets the operator 5 requested.

For example, for unexperienced operator 5 it might be preferable to limit the maximum speed of the driving in work site as well as the motion con- trols of the earthmoving machine E. Preferably, controls may have some other limitations or prerequisites to function such as whether the controllers CO are attached or detached, and whether detached, regarding the location of the con- trollers CO. For example, if the controllers CO are too far, the control system CS may disable the controllers CO and if the controllers CO are too near, the control — system CS may slow down the motions. < Preferably, the control system CS may be set to detect automatically or

N manually, in addition to the location of the operator 5, the direction or orientation a of the operator 5 with respect to the direction or orientation and location of the

N earthmoving machine EF, the boom 2 or the tool 3 and change the controls with 0 30 respect to these directions or orientations. For example, when the operator 5 is

E outside the cabin facing the earthmoving machine E and the boom 2, controlling

N the tool 3 to go left as seen by the operator 5, the tool 3 may go left as seen by the 2 side of the operator 5 and to right as seen by the side of the earthmoving machine = E.

N 35 Figure 2 discloses an operator 5 controlling an earthmoving machine E from outside the cabin 4. The operator 5 has a vest where the controllers CO are attached and a headset 18 provided with one or two head-mounted display units 6 depicted in figure 5. The head-mounted display with the controllers CO enables the operator 5 to operate the control system CS outside the cabin 4 like using the control system CS inside the cabin 4. Both the controllers CO and the headset 18 communicate with one or more control units CU through one or more communi- cation channel 19. The headset 18 may be used inside the cabin 4, as well. When using the headset 18 inside the cabin 4, the displaying means in the cabin 4 may be switched off if desired.

According to an embodiment, an operator selects to use only two con- trollers CO for controlling the operations of the earthmoving machine E. In the embodiment, the operator 5 is well experienced to use them so the operator 5 may detach the controllers CO and step outside the cabin 4 and continue, for ex- ample, after 5 second delay or one meter away from the earthmoving machine E, controlling the earthmoving machine E outside the cabin 4 with otherwise full — control, but, when driving the earthmoving machine E outside the cabin 4, the maximum speed is limited to 0,5 km/h, for example.

According to an embodiment, the control system CS comprises two controllers CO.

According to an embodiment, an operator 5 has another set of control- lers CO that the operator 5 uses when operating with detached controllers CO.

Thus, the operator 5 need not to detach those controllers CO that are attached in the cabin 4.

According to an embodiment, the sets of controllers CO each have a se- lector, for example a switch or a button or the like, to select whether the set of controllers CO is operating or not operating. If more than one set of controllers CO < is at the same time set to “operating” the certain earthmoving machine E, the

N closest set to the earthmoving machine overrides the other sets. This means that a if attached set of controllers CO is set to “operating”, it overrides the others and if

N the attached set is set to "not operating”, the control system CS of the earthmov- 0 30 ing machine E determines which of the controllers CO set to “operating” is the

E closest to the earthmoving machine E and lets the closest to operate and disables

AN the others. If there is two sets eguidistant to the earthmoving machine E set to

S “operating”, the control system CS may disable one or both and somehow signal = that too more sets of controllers CO is set to “operating” mode.

N 35 According to an embodiment, the set of controllers CO operating the earthmoving machine E may operate the earthmoving machine E over the Inter-

net or other suitable connection such that the operator 5 need not be within sight to the earthmoving machine E. These solutions may be suitable for mining pur- poses, for example. Thus, the operator 5 may operate the earthmoving machine E from outside the mine, for example. According to the embodiment, the operator 5 may have an additional visual connection (not shown) to the tool 3, surroundings of the earthmoving machine E or both via one or more video cameras (not shown) attached at suitable places in the earthmoving machine E such as carrier 1, cabin 4, boom 2 or tool 3.

The level of experience, or the skill level, may be set to the control sys- — tem CS manually by, for example, the operator 5 or the user with administrator privileges. The skill level may be set also by the control system CS itself, for ex- ample, by analyzing all the time the selections and controls given by the operator 5 or by retriving the history data gathered from the operator 5, meaning the user logged in, regarding the selections and controls given by the user or both. History — data may have been gathered both from the earthmoving machine E, from similar earthmoving machine, from any other earthmoving machine, from any other simi- lar machine and a simulator simulating some or any of the previously mentioned.

Analyzing selections and controls may contain, for example, data about how fast the user makes selections in between different menu items or jumps from one menu to the other or how quick or smooth the controls are in control- ling, for example, driving system, peripheral devices, maintenance system, road navigation system, work site navigation system, positioning the earthmoving tool 3 with respect to the work site, weighing system, automation system, measuring system and process control.

According to an embodiment, the skill level may be different regarding < what is been controlled, such that one operator, or user, may have high skill level

N in controlling the tool 3 and the other may have high skill level in using the driv- a ing system and so on.

N The data regarding each user, or operator, may contain information of 0 30 each user's experience regarding various earthmoving machines E and may be at

E least one of gathered, uploaded and downloaded by the earthmoving machine E,

AN uploaded and downloaded by the user and the operator and uploaded and down-

S loaded by the user with administrator privileges. Here uploading means transmit- = ting the gathered data from the control system CS to the cloud service or identity

N 35 card or the like and downloading means retrieving the history data or skill level data from the cloud service or identity card or the like to the control system CS.

Each earthmoving machine E may monitor the usage of the controllers CO in each situation, analyze it, gather it and upload it. The user with administrator privileg- es or the user himself or herself may insert the data according to his knowledge of the user's experience regarding to each kind of earthmoving machine E, for ex- ample, according to a test or an examination performed or passed.

The limitation, for example, to the maximum speed may be set by the supervisor of the work site, by the operator 5 himself or by the control system CS that has the data of the controlling hours outside the cabin operated by the opera- tor 5. When controlling the earthmoving machine E outside the cabin 4, the head- mounted display units 6 or the like or any other display unit 6 is not mandatory.

Using the controllers CO without seeing any display unit 6 does not necessarily restrict the current use of the earthmoving machine E, if the user remembers the selections needed without seeing them on any display.

According to an embodiment, when the sensors sensing the surround- ings of the tool 3 detect that the operator is in only one meter distance from the tool 3, the control system CS restricts the motion speeds of the earthmoving ma- chine E, the boom 2 and the tool 3 to, for example, 20% of the motion speeds set in unrestricted conditions to the operator 5.

Figure 3 show feasible earthmoving machines. Regarding the earth- — moving machine and the habits of the user, the number of the controllers CO may vary. Optimal amount of controllers CO in excavator is two. Also the amount of the controllers CO may be one, three or four. If the amount is three or four, one or two of them may be usable by feet, for example. Not all the controllers CO need be de- tachable. If only part of the controllers CO were detached, the operation mode of each controller CO may change, since the controllers CO not detached may be dis- < abled and the features of the disabled controllers CO may be added to the control-

N lers CO detached. Preferably the control system CS reguests user action whether a to change the operation mode or not.

N Figure 4a discloses a separate transparent display unit 6 or combiner 0 30 arranged at a distance from a windscreen 10. Figure 4b discloses a solution

E wherein a combiner 6 is fastened to an inner surface of the windscreen 10. Figure

AN 4c discloses an integrated solution wherein the transparent display unit 6 is lo-

S cated inside a structure of the windscreen 10. = Figure 5 discloses a headset 18 or media glasses provided with one or

N 35 more transparent display units 6. The headset 18 may communicate with one or more external or internal control units CU through one or more data communica-

tion 19. The same applies also for a helmet 20, depicted in figure 6, which is also provided with the transparent display units 6. In both arrangements the earth- moving images and data elements may be displayed so that they appear to locate at a visual distance from the transparent display units 6, which are located close to eyes of the operator.

It will be obvious to a person skilled in the art that, as the technology advances, the inventive concept can be implemented in various ways. The inven- tion and its embodiments are not limited to the examples described above but may vary within the scope of the claims. i

N

O

N

™

I a a

N

LO

O

K

O

N

Claims

1. A control system (CS) for controlling an earthmoving machine (E), the earthmoving machine (E) comprising a carrier (1), an earthmoving tool (3) and one to four controllers (CO), wherein an operator operates by the one to four controllers (CO) at least the earthmoving tool (3) and a driving system of the earthmoving machine (E), the control system (CS) comprising: one to four controllers (CO), wherein the operator operates by the one to four controllers (CO) at least the earthmoving tool (3) and the driving system of the earthmoving machine (E); and at least one control unit (CU), and at least one displaying means; wherein the at least one control unit (CU) is configured to receive se- lections and controls from the one to four controllers (CO) for controlling opera- tions of the earthmoving machine (E) controllable by the one to four controllers (CO),characterized in that: the one to four controllers (CO) are operable both attached and de- tached; the control system (CS) further comprises means for determining the location of each of the one to four controllers (CO) with respect to the earthmov- ing machine (E); and the at least one displaying means display the operations of the earth- moving machine (E) selectable and controllable by the one to four controllers (CO) to select an operation of the earthmoving machine (E) to control from the displayed operations to control the selected operation.

2. The control system (CS) according to claim 1, character- < iz ed in that the operation mode of the one to four controllers (CO) depends on N whether each of the one to four controllers (CO) are attached or detached.

a

3. The control system (CS) according to claim 1 or 2, charac- i terized in that the operation mode of each of the one to four controllers (CO), ® 30 — when detached, depends on the distance between these controllers (CO) and at E least one of: the earthmoving tool (3) of the earthmoving machine (E) and the Ql earthmoving machine (E). E |

4. The control system (CS) as claimed in any one of the preceding S claims, characterized in that the operation mode of the one to four con- N 35 — trollers (CO) depends on the distance between a detected obstacle and the earth- moving tool (3) or the earthmoving machine (E).

5. The control system (CS) as claimed in any one of the preceding claims, characterized in that the operation mode of the one to four con- trollers (CO) depends on the user specified adjustments made by or made for the user currently logged in to the control system (CS).

6. The control system (CS) as claimed in claim 5, character- ized in that the extent of the available adjustments depends on the skill level data of the user currently logged in, the skill level data being defined by at least one of: usage hours of the earthmoving machine (E), usage hours of the respective earthmoving machine (E), competence level accomplished or passed by an exam- ination or test.

7. The control system (CS) as claimed in any one of the preceding claims, characterized in that the operation of the earthmoving machine (E) controllable by the one to four controllers (CO) is at least one of: peripheral device, maintenance system, road navigation system, work site navigation system, positioning the earthmoving tool (3) with respect to the work site, moving the earthmoving tool (3) in relation to the carrier (1), weighing system, automation system, measuring system and process control.

8. The control system (CS) as claimed in any one of the preceding claims, characterized in that the control system (CS) gives feedback by at least one of the following signals: graphical, augmented reality, virtual reality, audiovisual, visual illumination, haptics and force-feedback.

9. The control system (CS) as claimed in claim 6, character- iz ed in that the user with administrator privileges define the skill level by edit- ing the skill level data of the user.

10. The control system (CS) according to claim 6 or 9, charac- < terized in thatthe user with administrator privileges define the skill level by N editing the skill level data of the user in a cloud service and the earthmoving ma- a chine (E) retrieves the data from the cloud service. i

11. The control system (CS) as claimed in any one of the preceding ® 30 claims,characterized in that the at least one control unit (CU) is config- E ured to receive selections and controls from the one to four controllers (CO) for Ql controlling at least one of: moving the tool (3) in relation to the carrier (1) and E the driving of the earthmoving machine (F). S

12. The control system (CS) as claimed in any one of the preceding N 35 claims, characterized in that the at least one control unit (CU) is config- ured to receive selections and controls from the one to four controllers (CO) for controlling all the operations of the earthmoving machine (E) controllable by the operator of the earthmoving machine (E).

13. The control system (CS) as claimed in any one of the preceding claims, characterized in that the amount of controllers (CO) is two to four and the operation mode of each of the two to four controllers (CO), when de- tached, depends on the distance between each other.

14. The control system (CS) as claimed in any one of the preceding claims, characterized in thatthe amount of controllers (CO) is two.

15. The control system (CS) as claimed in any one of the preceding claims,characterized in thatthe earthmoving tool (3) of the earthmoving machine (E) moves in three dimensional space according to coordinate system set manually, semiautomatically or automatically taking into account the location and/or orientation of the operator (5) and/or the one to four controllers (CO) with respect to the location and/or orientation of the earthmoving tool (3) and/or the earthmoving machine (E).

16. An earthmoving machine (E), the earthmoving machine (E) com- prising: a movable carrier (1); at least one earthmoving tool (3); one to four controllers (CO), wherein an operator operates by the one to four controllers (CO) at least the at least one earthmoving tool (3) and a driving system of the earthmoving machine (E); peripheral devices, wherein the operator operates the one to four con- trollers (CO) to control the peripheral devices; actuating means for moving the earthmoving tool (3) in relation to the < carrier (1); and S a control system (CS), wherein the control system comprises: e a control unit (CU) for controlling the operations of the earthmov- N ing machine (E); 0 30 sensing means (11, 12) for providing the control unit (CU) with E position data of the earthmoving tool (3) and the carrier (1); Ql at least one displaying means; and S one to four controllers (CO) for the operator to operate at least the = at least one earthmoving tool (3) and the driving system of the earth- N 35 moving machine (E); and wherein the at least one control unit (CU) is configured to receive selections and controls from the one to four controllers (CO) for controlling operations of the earthmoving machine (E) controllable by the one to four controllers (CO), characterizedinthat the one to four controllers (CO) are operable both attached and de- tached; the control system (CS) further comprises means for determining the location of each of the one to four controllers (CO) with respect to the earthmov- ing machine (E); and the at least one displaying means display the operations of the earth- moving machine (E) selectable and controllable by the one to four controllers (CO) to select an operation of the earthmoving machine (E) to control from the displayed operations to control the selected operation.

17. The earthmoving machine (E) as claimed in claim 16, charac- terized in that the earthmoving machine (E) is one of the following: excava- — tor, bulldozer, motor grader, compaction machine, piling machine, deep stabiliza- tion machine, surface top drilling machine.

18. A method for controlling an earthmoving machine (E) by at least one controller (CO), wherein the earthmoving machine (E) comprises a carrier (1) and an earthmoving tool (3), characterized in that the method compris- es: determining an operation mode of the at least one controller (CO) by determining whether the at least one controller (CO) is at- tached or detached, wherein the at least one controller (CO) is operable to oper- ate at least the earthmoving tool (3) and a driving system of the earthmoving ma- — chine (E) both attached and detached; and < by determining the location of the at least one controller (CO); N selecting, in the determined operation mode, an operation to control a from selectable and controllable operations displayed by at least one displaying N means containing operations of the earthmoving machine (E) controllable by the 0 30 atleast one controller (CO) and E controlling the selected operation of the earthmoving machine (E). N

19. A computer program product comprising executable code that 2 when executed, cause execution of functions according to any one of claims 1-15 = and 18. i

20. A computer program embodied on a non-transitory computer readable storage medium, the computer program being configured to control a processor to execute functions according to any one of claims 1 - 15 and 18. i N O N N ™ I a a N LO O O K O N