US20150006143A1 - Semantic translation model training - Google Patents
Semantic translation model training Download PDFInfo
- Publication number
- US20150006143A1 US20150006143A1 US13/929,090 US201313929090A US2015006143A1 US 20150006143 A1 US20150006143 A1 US 20150006143A1 US 201313929090 A US201313929090 A US 201313929090A US 2015006143 A1 US2015006143 A1 US 2015006143A1
- Authority
- US
- United States
- Prior art keywords
- language
- question
- electronic communication
- content
- answer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G06F17/28—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/205—Parsing
- G06F40/211—Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/263—Language identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
- G06F40/58—Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
Definitions
- the present disclosure is generally directed toward communications and more specifically toward contact centers.
- Machine translation of language can be problematic as simple substitution of words in one language for words in another does not typically produce a good translation.
- machine translation may be effective, but machine translation in an interactive environment is ineffective and leads to customer dissatisfaction.
- the present disclosure is directed to a semantic translation model system which is operable to build a structure able to handle multiple languages to answer questions in an interactive domain like, but not limited to, an automated chat session, a contact center environment, and/or one or more HTML documents.
- Semantics is the study of meaning that focuses on the relationship between signifiers (e.g., words, phrases, signs, and symbols) and their meaning.
- Linguistic semantics is the study of meaning that is used for understanding human expression through language.
- semantics is the study of interpretation of signifiers used in particular circumstances and contexts. For example, in written language, paragraph structure and punctuation bear identifiable semantic content. Each language has identifiable semantic content. Many languages share roots of words, allowing some comprehension by speakers of other languages in many instances.
- the vocabulary, grammar, and other characteristics can be identified through semantic content analysis. Two key components include an ability to analyze a core meaning of the language segment and identify a sentence or segment to ask a question about (identify subject, verb, object, etc.).
- Subjects, verbs, and objects tend to be considered syntactically. Shallow semantics consider words like agent, patient, and theme, or more specific roles like sender and receiver. Syntactic labels essentially serve as shorthand for knowing who was doing what to whom. With subject/objects, there may be a structural aspect of the subject/object with relation to the verb, but there may be no inferential meaning as in the following example:
- the semantic translation model system builds a structure operable to answer questions in an automated chat session.
- the semantic translation model system can create the structure based on a large amount of known question and answer pairs, key word translation, semantic analysis, syntactic analysis, and language rules and structure.
- the semantic translation model system can automatically generate language training materials in additional languages based on a configured source language, reducing the requirements of specific language skills and domain knowledge in multiple languages.
- the semantic translation model system analyzes the text training materials for one language at a semantic and topic/domain level.
- the knowledge base in multiple languages can be created based on curated question/answer pairs.
- the knowledge base assists with the training because the semantic translation model system can start from a base language and then move to a new language.
- the semantic translation model system creates an intermediate representation of the knowledge one needs to map dialogs from one language to another.
- the semantic level is then automatically translated to the target language based on language rules and word usage.
- the semantic translation model system takes into account the normal speech patterns of the target languages.
- the semantic translation model system includes a process flow, segment patterning, syntactic topic patterning, and keyword translation.
- the semantic translation model system does a topic/noun translation and then creates a new sentence within the appropriate language based on knowledge of language's structure. The words are worked into the proper combinations using the semantics of the target language to automatically generate the training materials for the target language.
- a text processing and automatic answer generation system is created for a bank customer in English for use in chat and social media sessions.
- the system is able to analyze incoming questions about loans, balances, accounts, and other basic banking information.
- the goal is to take the configured system in English, and upon request by a customer, use the invention to create a functional system in Vietnamese.
- the semantic translation model system will take the data collected from the English system and perform the segmentation, semantic, and syntactic analysis for English banking type interactions (i.e. semantic structure on how people ask for their payment history).
- the English text can be translated at a semantic/structural level into the target language, Vietnamese.
- the process is repeated for all forms of interactions, including questions and matching automated answers.
- topic or domain words, phrases, and constructs are identified as the second set of information to be translated (i.e. loan balance, interest rate, rate, payment history, etc.).
- the system will automatically combine the components using the translated parts and the target language (Turkish) linguistic rules.
- the result is a Vietnamese model for questions and answers.
- the system can accept Vietnamese inquiries about the same topics supported in the English model.
- the Turkish version will be functional based on actual Turkish ways of speaking, on linguistic rules for the Vietnamese language, and on signifiers specific to the banking domain.
- the semantic translation model training system can be used in a contact center environment, though not limited as such. Additionally, the semantic translation model training system may be used in many areas of business, including, but not limited to, banking, healthcare, emergency response, and other types of customer service venues.
- automated refers to any process or operation done without material human input when the process or operation is performed. However, a process or operation can be automatic, even though performance of the process or operation uses material or immaterial human input, if input is received before performance of the process or operation. Human input is deemed to be material if such input influences how the process or operation will be performed. Human input that consents to the performance of the process or operation is not deemed to be “material.”
- Non-volatile media includes, for example, NVRAM, or magnetic or optical disks.
- Volatile media includes dynamic memory, such as main memory.
- Computer-readable media include, for example, a floppy disk (including without limitation a Bernoulli cartridge, ZIP drive, and JAZ drive), a flexible disk, hard disk, magnetic tape or cassettes, or any other magnetic medium, magneto-optical medium, a digital video disk (such as CD-ROM), any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, a solid state medium like a memory card, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.
- a floppy disk including without limitation a Bernoulli cartridge, ZIP drive, and JAZ drive
- a flexible disk including without limitation a Bernoulli cartridge, ZIP drive, and JAZ drive
- hard disk hard disk
- magnetic tape or cassettes or any other magnetic medium
- magneto-optical medium such as CD-ROM
- CD-ROM digital video disk
- any other optical medium punch cards, paper
- a digital file attachment to e-mail or other self-contained information archive or set of archives is considered a distribution medium equivalent to a tangible storage medium.
- the computer-readable media is configured as a database, it is to be understood that the database may be any type of database, such as relational, hierarchical, object-oriented, and/or the like. Accordingly, the disclosure is considered to include a tangible storage medium or distribution medium and prior art-recognized equivalents and successor media, in which the software implementations of the present disclosure are stored.
- Computer-readable storage medium commonly excludes transient storage media, particularly electrical, magnetic, electromagnetic, optical, magneto-optical signals.
- customer or “client” denotes a party patronizing, serviced by, or otherwise doing business with a contact center, business, or enterprise.
- a “database” as used herein refers to an organized set of data held in a computer.
- the organization schema or model for the data can, for example, be hierarchical, network, relational, entity-relationship, object, document, XML, entity-attribute-value model, star schema, object-relational, associative, multidimensional, multi-value, semantic, and other database designs.
- module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and software that is capable of performing the functionality associated with that element. Also, while the disclosure is presented in terms of exemplary embodiments, it should be appreciated that individual aspects of the disclosure can be separately claimed.
- FIG. 1 is an example of a semantic translation model training system in accordance with embodiments of the present disclosure
- FIG. 2 is a block diagram of a communication system in accordance with embodiments of the present disclosure
- FIG. 3 is an example of a request from a customer to the semantic translation model training system in accordance with embodiments of the present disclosure
- FIG. 4 depicts a flow diagram for creation of question and answer pairs in accordance with embodiments of the present disclosure
- FIG. 5 depicts a flow diagram for creating a new language model in accordance with embodiments of the present disclosure.
- FIG. 6 is a data diagram of data that is used by the semantic translation model training system in accordance with embodiments of the present disclosure.
- FIG. 1 shows an illustrative embodiment of a semantic translation model training system in accordance with at least some embodiments of the present disclosure.
- a semantic translation model training system language domain 1 100 a and a language domain 2 100 b may be connected by a module 108 .
- Language domain 1 100 a and language domain 2 100 b are areas that may contain and have the ability to store customized sets of keywords, phrases, questions, and answers in a particular language.
- a semantic translation model training system may be operable to translate keywords and phrases in a first language domain (e.g., English) to keywords and phrases in a second language domain (e.g., Turkish).
- the language domain 1 100 a and the language domain 2 100 b contain keywords, phrases, for segmentation, semantic, and syntactic analysis.
- a translation module 108 may sit on a boundary between language domain 1 100 a and language domain 2 100 b .
- the translation module 108 can facilitate translation capabilities between the two language domains 100 a , 100 b .
- the translation module 108 is operable to receive a dialog 104 , recognize a first language question and determine if an answer exists. Additionally, the translation module 108 can automatically create a translation of a question and answer pair in a second language based on analysis and system training.
- the translation module 108 can include a segmentation application 112 , a semantic application 116 , and a syntactic application 120 .
- the translation module 108 can further create new dialogs 104 (e.g., “Sipari im ne zaman gönderilecek?” 104 b ) in language domain 2 100 b based on questions and/or answers in the language domain 1 100 a (e.g., “When will my order ship?” 104 a ).
- the translation module 108 can combine components to create question and answer components in the second language in language domain 2 100 b.
- the translation module 108 uses the segmentation application 112 , the semantic analyzer 116 , and the syntactic analyzer 120 to create a model in language domain 2 100 b .
- Dialog 2 104 b contains the question based on the translation of the question in dialog 1 104 a , reconstructed in a new language model.
- the semantic translation model training system may be described in some embodiments for use in a contact center, it is not necessarily so limited.
- the semantic translation model training system may be used in any type or form of business for automatic modeling and translation services.
- FIG. 2 shows an illustrative embodiment of a communication system 200 in accordance with at least some embodiments of the present disclosure.
- the communication system 200 may be a distributed system and, in some embodiments, comprises a communication network 204 connecting one or more customer communication devices 208 to a work assignment mechanism 216 , which may be owned and operated by an enterprise administering a contact center in which a plurality of resources 212 are distributed to handle incoming work items from the customer communication devices 208 .
- the communication network 204 may comprise any type of known communication medium or collection of communication media and may use any type of protocols to transport messages between endpoints.
- the communication network 204 may include wired and/or wireless communication technologies.
- the Internet is an example of the communication network 204 that constitutes and Internet Protocol (IP) network consisting of many computers, computing networks, and other communication devices located all over the world, which are connected through many telephone systems and other means.
- IP Internet Protocol
- the communication network 204 examples include, without limitation, a standard Plain Old Telephone System (POTS), an Integrated Services Digital Network (ISDN), the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Voice over Internet Protocol (VoIP) network, a Session Initiation Protocol (SIP) network, a cellular network, and any other type of packet-switched or circuit-switched network known in the art.
- POTS Plain Old Telephone System
- ISDN Integrated Services Digital Network
- PSTN Public Switched Telephone Network
- LAN Local Area Network
- WAN Wide Area Network
- VoIP Voice over Internet Protocol
- Session Initiation Protocol SIP
- the communication network 204 need not be limited to any one network type, and instead may be comprised of a number of different networks and/or network types.
- embodiments of the present disclosure may be utilized to increase the efficiency of a grid-based contact center.
- the communication network 204 may comprise a number of different communication media such as coaxial cable, copper cable/wire, fiber-optic cable, antennas for transmitting/receiving wireless messages, and combinations thereof.
- the communication devices 208 may correspond to customer communication devices.
- a customer may utilize their communication device 208 to initiate a work item, which is generally a request for a processing resource 212 .
- Exemplary work items include, but are not limited to, a contact directed toward and received at a contact center, a web page request directed toward and received at a server farm (e.g., collection of servers), a media request, an application request (e.g., a request for application resources location on a remote application server, such as a SIP application server), and the like.
- the work item may be in the form of a message or collection of messages transmitted over the communication network 204 .
- the work item may be transmitted as a telephone call, a packet or collection of packets (e.g., IP packets transmitted over an IP network), an email message, an Instant Message, an SMS message, a fax, and combinations thereof.
- the work assignment mechanism 216 may employ any queue-based or queueless work assignment algorithm.
- queue-based work assignment skill-based algorithms include, without limitation, a fairness algorithm, pacing algorithm (which inserts rests into the agents work queue), value-based algorithms, limited algorithms (such as Business AdvocateTM by Avaya, Inc.), and outsourcing algorithms. Other algorithms may consider other types of data inputs and/or may treat certain data inputs differently.
- the format of the work item may depend upon the capabilities of the communication device 208 and the format of the communication.
- work items are logical representations within a contact center of work to be performed in connection with servicing a communication received at the contact center (and more specifically the work assignment mechanism 216 ).
- the communication may be received and maintained at the work assignment mechanism 216 , a switch or server connected to the work assignment mechanism 216 , or the like until a resource 212 is assigned to the work item representing that communication at which point the work assignment mechanism 216 passes the work item to a routing engine 224 to connect the communication device 208 to the assigned resource 212 .
- routing engine 224 is depicted as being separate from the work assignment mechanism 216 , the routing engine 224 may be incorporated into the work assignment mechanism 216 or its functionality may be executed by the work assignment engine 220 .
- the communication devices 208 may comprise any type of known communication equipment or collection of communication equipment.
- Examples of a suitable communication device 208 include, but are not limited to, a personal computer, laptop, tablet, cellular phone, smartphone, telephone, or combinations thereof.
- each communication device 208 may be adapted to support video, audio, text, and/or data communications with other communication devices 208 as well as the processing resources 212 .
- the type of medium used by the communication device 208 to communicate with other communication devices 208 or processing resources 212 may depend upon the communication applications available on the communication device 208 .
- the work item can be sent toward a collection of processing resources 212 via the combined efforts of the work assignment mechanism 216 and routing engine 224 .
- the resources 212 can either be completely automated resources (e.g., Interactive Voice Response (IVR) units, processors, servers, or the like), human resources utilizing communication devices (e.g., human agents utilizing a computer, telephone, laptop, etc.), or any other resource known to be used in contact centers.
- IVR Interactive Voice Response
- the work assignment mechanism 216 and resources 212 may be owned and operated by a common entity in a contact center format.
- the work assignment mechanism 216 may be administered by multiple enterprises, each of which has their own dedicated resources 212 a - n connected to the work assignment mechanism 216 .
- the work assignment mechanism 216 comprises a work assignment engine 220 which enables the work assignment mechanism 216 to make intelligent routing decisions for work items.
- the work assignment engine 220 may be configured to administer and make work assignment decisions in a queueless contact center, as is described in U.S. patent application Ser. No. 12/882,950, to Flockhart et al, the entire contents of which are hereby incorporated herein by reference.
- the work assignment engine 220 can determine which of the plurality of processing resources 212 is qualified and/or eligible to receive the work item and further determine which of the plurality of processing resources 212 is best suited (or is the optimal processing resource) to handle the processing needs of the work item. In situations of work item surplus, the work assignment engine 220 can also make the opposite determination (i.e., determine optimal assignment of a work item resource to a resource). In some embodiments, the work assignment engine 220 can be configured to achieve true one-to-one matching by utilizing bitmaps/tables and other data structures.
- an agent scripter 228 comprises a web-based user interface that provides the resource 212 with contextual information for consistency in dealing with customers. More specifically, the agent scripter 228 can evaluate a dialog 104 received from the communication network 204 from a customer communication device 208 . Information provided by the agent scripter 228 can be used by the work assignment engine 220 to assist resources 212 as questions are received in the form of dialogs 104 a - n.
- FIG. 3 illustrates an example of a request from a customer to a website requiring the services of the semantic translation model training system.
- the request process 300 may include, in some embodiments, a customer communication device 208 connected via the Internet to one or more web servers 308 , which may be owned and operated by an enterprise administering a contact center in which a translation module 108 , a database server 312 , and a database 316 operable to set up a session to handle incoming requests and queries from the customer communication device 208 .
- the customer 304 may have a question for a company.
- the customer 304 may choose to check a website through a customer communication device 208 connected to a web server 308 .
- the session begins with a browser request 320 from the customer 304 .
- the web server 308 can determine the desired language from the browser request 320 .
- the language request 324 may be sent to a translation module 108 for analysis. If the language request 324 is in a first language, the translation module 108 may query 328 a database 316 for display information requested by the page. If the language request 324 is in a second language, the translation module 108 may initiate a language query 328 , potentially causing the semantic translation model training system to create a new language model.
- a customer 304 in Ankara may wish to read through a Frequently Asked Questions (FAQ) page provided by a company.
- the company may be located in the United States, and as such, the FAQ page would typically be published in English.
- the customer 304 may initiate a browser request 320 for the FAQ page to be displayed in Vietnamese.
- the language request 324 may be forwarded to the translation module 108 if a new language model is needed. If the language model for Vietnamese has been created previously, the page may be returned to the web server 308 for display at the customer communication device 208 in Vietnamese.
- the translation module 108 may perform a segmentation using the segmentation application 112 , a semantic analysis using the semantic analyzer 116 , and a syntactic analysis using the syntactic analyzer 120 in conjunction with a data server 312 .
- the translation module 108 can automatically analyze the content and structure of the FAQ question and answer pairs if a language model for Vietnamese does not yet exist.
- the semantic translation model training system may create a Vietnamese language model by initiating a database lookup 332 for keywords, grammar, and language rules and creating a display of the FAQ question and answer pairs in Vietnamese for the customer 304 .
- the model may provide the translation with a database lookup 332 since the model for Vietnamese already exists. If a third customer in Lima, Peru, sends a browser request 320 for the FAQ page to be displayed in Spanish, the model may create a model and a translation based on the existing language models and known question and answer pairs in the first language (English) and the second language (Turkish).
- the method 400 begins with a start operation 404 and terminates with an end operation 440 . While a general order for the steps of the method 400 are shown in FIG. 4 , the method 400 can include more or fewer steps or the order of the steps can be arranged differently than those shown in FIG. 4 .
- the method 400 can be executed as a set of computer-executable instructions executed by a computer system and encoded or stored on a computer readable medium.
- the method may also be embodied by a set of gates or other structures in an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other configurable hardware component, module, or system.
- ASIC Application Specific Integrated Circuit
- FPGA Field Programmable Gate Array
- the method 400 shall be explained with reference to the systems, components, modules, software, data structures, etc. described in conjunction with FIGS. 1-3 .
- the process idles at step 404 until a dialog 104 has been received, in step 408 .
- the translation module 108 may determine a language of the dialog 104 . Once the language of the dialog 104 has been established, the translation module 108 may determine if an answer to a question presented in the dialog 104 is available in the identified language, in step 416 . If the answer to the question presented in the dialog 104 is available in the identified language, then the question may be paired with the answer, in step 420 , based on a database lookup 332 , query mechanism, or other technique to pair the question and the answer. The question and answer pair may be scanned for the identification of keywords by the translation module 108 , in step 424 . The question and answer pair may be stored for further use and/or translation in step 436 .
- the question presented in the dialog 104 may be sent to an agent for processing, in step 428 .
- an automatic search and discovery for the answer can be used for step 428 .
- the agent 212 or communication system 200 may find an answer to the question presented in the dialog 104 and pair it with the question presented in the dialog 104 , in step 432 .
- the question and answer pair may be stored for further use and/or translation in step 436 .
- the method 400 for creating and storing question and answer pairs ends, at step 440 .
- the method 500 for creating a language model in accordance with embodiments of the present disclosure is shown in FIG. 5 .
- the method 500 begins with a start operation 504 and terminates with an end operation 552 . While a general order for the steps of the method 500 are shown in FIG. 5 , the method 500 can include more or fewer steps or the order of the steps can be arranged differently than those shown in FIG. 5 .
- the method 500 can be executed as a set of computer-executable instructions executed by a computer system and encoded or stored on a computer readable medium. Further, the method may also be embodied by a set of gates or other structures in an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other configurable hardware component, module, or system.
- ASIC Application Specific Integrated Circuit
- FPGA Field Programmable Gate Array
- Dialog segment patterns may be identified and separated for analysis by the segmentation application 112 in the translation module 108 , in step 512 .
- the dialog 104 a in the form of a first language may be semantically and/or structurally translated in step 512 by the semantic analyzer 116 in the translation module 108 .
- Semantic analysis typically includes the ability to analyze core meaning, including identification of a subject, verb, or object. Segments may also be identified at a topic and/or domain level. Vocabulary, grammar, and other characteristics may be identified through the semantic content analysis. It is at the semantic level where the question may be translated to the target language based on rules and word usage.
- Syntactic analysis in step 512 by the syntactic analyzer 120 in the translation module 108 can involve parsing, or breaking down, the dialog segment 104 into its component parts of speech with an explanation of the form, function, and relationship between the components. Syntactic analysis may involve working the words into proper combinations using the results of the semantic analysis. The product of the analyses may be used to automatically generate the training materials, including an intermediate representation of the keyword translations, for the second language.
- the dialog 104 a in the form of a first language may be concurrently translated, in step 516 .
- the semantic translation model training system may automatically combine the semantic/structural translation and the topic and/or domain words, phrases, constructs, and the first language translation and then apply linguistic rules, in step 520 .
- the representative translation is used to map the dialog 104 from a base language to another language, thereby creating a new language model, in step 524 .
- step 528 after the new model has been created, a determination is made as to whether or not an answer exists for the question present in the dialog 104 . If the answer to the query is yes, then the question from the dialog 104 may be paired with the answer, in step 532 . Within the question and answer pair, keywords may be identified and/or marked, in step 536 . If the answer to the query is no, then the question from the dialog 104 may be sent to an agent and/or communication system resource 212 , in step 540 . Once the agent and/or communication resource 212 finds or creates an answer to the question in the dialog 104 , the agent and/or communication resource 212 may create a new question and answer pair, in step 544 . The output of steps 536 and 544 may be stored as and displayed as question and answer pairs, in step 548 . At step 552 , the process ends.
- semantic translation data 600 An embodiment of semantic translation data 600 is shown in FIG. 6 .
- the semantic translation data 600 may include specific information from interactions with a third party, a direct customer of the contact center, or other users of the semantic translation model through a browser or other system mechanism.
- the semantic translation data 600 may include metadata.
- the metadata may include information on the user's language 604 . It may also include a keyword 608 that may be associated with a communication that is to be translated.
- the database information may include the question and answer pair 612 from the dialog 104 .
- the structural translation field 616 can include one or more words translated by the model.
- the linguistic rules 620 may include grammar or structural guidelines for the target language.
- the model field 624 may include information including semantic analysis and syntactic analysis data for models that have been created.
- the stored information may include communication and context information important in a response to a request for an FAQ display and/or a query in a chat session.
- the response display and/or message may be provided by the contact center and may be automatically sent or sent by a human agent resource 112 .
- Information from the database 316 may also include question and answer information that has been collected in response to multiple interactions with a company or a contact center. While there are only six input fields 604 , 608 , 612 , 616 , 620 , and 624 as shown in FIG. 6 , there may be more or fewer data fields associated with data structure 600 .
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Machine Translation (AREA)
Abstract
Description
- The present disclosure is generally directed toward communications and more specifically toward contact centers.
- Automated systems and analysis procedures for text-based interactions (email, chat, and social media) rely on text models of language with domain-specific information. Configuration, training, and translation can be expensive and time-consuming processes that require experts in the language and the domain. It is often difficult to justify the large financial and time costs associated with employing several people to create translations in multiple languages. There is also a lack of consistency in translation methodology and cultural adaptation.
- Automatic machine translation of language can be problematic as simple substitution of words in one language for words in another does not typically produce a good translation. Within limited domains, machine translation may be effective, but machine translation in an interactive environment is ineffective and leads to customer dissatisfaction.
- The complexity and expense of domain-specific translation in an interactive environment encourages the development of a new approach to address these issues. Additionally, the new approach needs to be a living model, one that is not static and does not require expensive periodic intervention by translators to remain current.
- These and other needs are addressed by the various aspects, embodiments, and/or configurations of the present disclosure. The present disclosure is directed to a semantic translation model system which is operable to build a structure able to handle multiple languages to answer questions in an interactive domain like, but not limited to, an automated chat session, a contact center environment, and/or one or more HTML documents.
- Semantics is the study of meaning that focuses on the relationship between signifiers (e.g., words, phrases, signs, and symbols) and their meaning. Linguistic semantics is the study of meaning that is used for understanding human expression through language. In linguistics, semantics is the study of interpretation of signifiers used in particular circumstances and contexts. For example, in written language, paragraph structure and punctuation bear identifiable semantic content. Each language has identifiable semantic content. Many languages share roots of words, allowing some comprehension by speakers of other languages in many instances. The vocabulary, grammar, and other characteristics can be identified through semantic content analysis. Two key components include an ability to analyze a core meaning of the language segment and identify a sentence or segment to ask a question about (identify subject, verb, object, etc.).
- Subjects, verbs, and objects tend to be considered syntactically. Shallow semantics consider words like agent, patient, and theme, or more specific roles like sender and receiver. Syntactic labels essentially serve as shorthand for knowing who was doing what to whom. With subject/objects, there may be a structural aspect of the subject/object with relation to the verb, but there may be no inferential meaning as in the following example:
-
- [John agent] [gave predicate] [the ball theme] to [Mary receiver]
- [Dave agent] [drove predicate] [the car] through [the tunnel path]
- The semantic translation model system builds a structure operable to answer questions in an automated chat session. The semantic translation model system can create the structure based on a large amount of known question and answer pairs, key word translation, semantic analysis, syntactic analysis, and language rules and structure. The semantic translation model system can automatically generate language training materials in additional languages based on a configured source language, reducing the requirements of specific language skills and domain knowledge in multiple languages.
- The semantic translation model system analyzes the text training materials for one language at a semantic and topic/domain level. The knowledge base in multiple languages can be created based on curated question/answer pairs. The knowledge base assists with the training because the semantic translation model system can start from a base language and then move to a new language. The semantic translation model system creates an intermediate representation of the knowledge one needs to map dialogs from one language to another. The semantic level is then automatically translated to the target language based on language rules and word usage. The semantic translation model system takes into account the normal speech patterns of the target languages. The semantic translation model system includes a process flow, segment patterning, syntactic topic patterning, and keyword translation. The semantic translation model system does a topic/noun translation and then creates a new sentence within the appropriate language based on knowledge of language's structure. The words are worked into the proper combinations using the semantics of the target language to automatically generate the training materials for the target language.
- For example, a text processing and automatic answer generation system is created for a bank customer in English for use in chat and social media sessions. The system is able to analyze incoming questions about loans, balances, accounts, and other basic banking information. The goal is to take the configured system in English, and upon request by a customer, use the invention to create a functional system in Turkish.
- The semantic translation model system will take the data collected from the English system and perform the segmentation, semantic, and syntactic analysis for English banking type interactions (i.e. semantic structure on how people ask for their payment history). The English text can be translated at a semantic/structural level into the target language, Turkish. The process is repeated for all forms of interactions, including questions and matching automated answers. In addition, topic or domain words, phrases, and constructs are identified as the second set of information to be translated (i.e. loan balance, interest rate, rate, payment history, etc.).
- With the two key components in place, the system will automatically combine the components using the translated parts and the target language (Turkish) linguistic rules. The result is a Turkish model for questions and answers. The system can accept Turkish inquiries about the same topics supported in the English model. The Turkish version will be functional based on actual Turkish ways of speaking, on linguistic rules for the Turkish language, and on signifiers specific to the banking domain.
- Generally, there will be proper names of products, companies and technologies that will not be translated between languages. The system will provide proper name protection from translation by identifying these elements in the source text and preserving them in the translated version. For example, “Avaya” would not be translated between languages as it is a language independent symbol.
- In additional embodiments, the semantic translation model training system can be used in a contact center environment, though not limited as such. Additionally, the semantic translation model training system may be used in many areas of business, including, but not limited to, banking, healthcare, emergency response, and other types of customer service venues.
- These and other advantages will be apparent from the disclosure.
- The term “automatic” and variations thereof, as used herein, refers to any process or operation done without material human input when the process or operation is performed. However, a process or operation can be automatic, even though performance of the process or operation uses material or immaterial human input, if input is received before performance of the process or operation. Human input is deemed to be material if such input influences how the process or operation will be performed. Human input that consents to the performance of the process or operation is not deemed to be “material.”
- The term “computer-readable medium” as used herein refers to any storage and/or transmission medium that participate in providing instructions to a processor for execution. Such a medium is commonly tangible and non-transient and can take many forms, including but not limited to, non-volatile media, volatile media, and transmission media and includes without limitation random access memory (“RAM”), read only memory (“ROM”), and the like. Non-volatile media includes, for example, NVRAM, or magnetic or optical disks. Volatile media includes dynamic memory, such as main memory. Common forms of computer-readable media include, for example, a floppy disk (including without limitation a Bernoulli cartridge, ZIP drive, and JAZ drive), a flexible disk, hard disk, magnetic tape or cassettes, or any other magnetic medium, magneto-optical medium, a digital video disk (such as CD-ROM), any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, a solid state medium like a memory card, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read. A digital file attachment to e-mail or other self-contained information archive or set of archives is considered a distribution medium equivalent to a tangible storage medium. When the computer-readable media is configured as a database, it is to be understood that the database may be any type of database, such as relational, hierarchical, object-oriented, and/or the like. Accordingly, the disclosure is considered to include a tangible storage medium or distribution medium and prior art-recognized equivalents and successor media, in which the software implementations of the present disclosure are stored. Computer-readable storage medium commonly excludes transient storage media, particularly electrical, magnetic, electromagnetic, optical, magneto-optical signals.
- The term “customer” or “client” denotes a party patronizing, serviced by, or otherwise doing business with a contact center, business, or enterprise.
- A “database” as used herein refers to an organized set of data held in a computer. The organization schema or model for the data can, for example, be hierarchical, network, relational, entity-relationship, object, document, XML, entity-attribute-value model, star schema, object-relational, associative, multidimensional, multi-value, semantic, and other database designs.
- The terms “determine,” “calculate,” and “compute,” and variations thereof as used herein, are used interchangeably and include any type of methodology, process, mathematical operation or technique.
- The term “means” as used herein shall be given its broadest possible interpretation in accordance with 35 U.S.C.,
Section 112, Paragraph 6. Accordingly, a claim incorporating the term “means” shall cover all structures, materials, or acts set forth herein, and all of the equivalents thereof. Further, the structures, materials or acts and the equivalents thereof shall include all those described in the summary of the invention, brief description of the drawings, detailed description, abstract, and claims themselves. - The term “module” as used herein refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and software that is capable of performing the functionality associated with that element. Also, while the disclosure is presented in terms of exemplary embodiments, it should be appreciated that individual aspects of the disclosure can be separately claimed.
- The preceding is a simplified summary of the disclosure to provide an understanding of some aspects of the disclosure. This summary is neither an extensive nor exhaustive overview of the disclosure and its various aspects, embodiments, and/or configurations. It is intended neither to identify key or critical elements of the disclosure nor to delineate the scope of the disclosure but to present selected concepts of the disclosure in a simplified form as an introduction to the more detailed description presented below. As will be appreciated, other aspects, embodiments, and/or configurations of the disclosure are possible utilizing, alone or in combination, one or more of the features set forth above or described in detail below.
-
FIG. 1 is an example of a semantic translation model training system in accordance with embodiments of the present disclosure; -
FIG. 2 is a block diagram of a communication system in accordance with embodiments of the present disclosure; -
FIG. 3 is an example of a request from a customer to the semantic translation model training system in accordance with embodiments of the present disclosure; -
FIG. 4 depicts a flow diagram for creation of question and answer pairs in accordance with embodiments of the present disclosure; -
FIG. 5 depicts a flow diagram for creating a new language model in accordance with embodiments of the present disclosure; and -
FIG. 6 is a data diagram of data that is used by the semantic translation model training system in accordance with embodiments of the present disclosure. -
FIG. 1 shows an illustrative embodiment of a semantic translation model training system in accordance with at least some embodiments of the present disclosure. A semantic translation model trainingsystem language domain 1 100 a and alanguage domain 2 100 b may be connected by amodule 108.Language domain 1 100 a andlanguage domain 2 100 b are areas that may contain and have the ability to store customized sets of keywords, phrases, questions, and answers in a particular language. A semantic translation model training system may be operable to translate keywords and phrases in a first language domain (e.g., English) to keywords and phrases in a second language domain (e.g., Turkish). Thelanguage domain 1 100 a and thelanguage domain 2 100 b contain keywords, phrases, for segmentation, semantic, and syntactic analysis. - A
translation module 108 may sit on a boundary betweenlanguage domain 1 100 a andlanguage domain 2 100 b. Thetranslation module 108 can facilitate translation capabilities between the twolanguage domains translation module 108 is operable to receive a dialog 104, recognize a first language question and determine if an answer exists. Additionally, thetranslation module 108 can automatically create a translation of a question and answer pair in a second language based on analysis and system training. - More particularly, the
translation module 108 can include asegmentation application 112, asemantic application 116, and asyntactic application 120. Thetranslation module 108 can further create new dialogs 104 (e.g., “Sipariim ne zaman gönderilecek?” 104 b) inlanguage domain 2 100 b based on questions and/or answers in thelanguage domain 1 100 a (e.g., “When will my order ship?” 104 a). In addition to detecting a question and/or answer to a first language question, thetranslation module 108 can combine components to create question and answer components in the second language inlanguage domain 2 100 b. - The
translation module 108 uses thesegmentation application 112, thesemantic analyzer 116, and thesyntactic analyzer 120 to create a model inlanguage domain 2 100 b.Dialog 2 104 b contains the question based on the translation of the question indialog 1 104 a, reconstructed in a new language model. Although the semantic translation model training system may be described in some embodiments for use in a contact center, it is not necessarily so limited. The semantic translation model training system may be used in any type or form of business for automatic modeling and translation services. -
FIG. 2 shows an illustrative embodiment of acommunication system 200 in accordance with at least some embodiments of the present disclosure. Thecommunication system 200 may be a distributed system and, in some embodiments, comprises acommunication network 204 connecting one or morecustomer communication devices 208 to awork assignment mechanism 216, which may be owned and operated by an enterprise administering a contact center in which a plurality ofresources 212 are distributed to handle incoming work items from thecustomer communication devices 208. - In accordance with at least some embodiments of the present disclosure, the
communication network 204 may comprise any type of known communication medium or collection of communication media and may use any type of protocols to transport messages between endpoints. Thecommunication network 204 may include wired and/or wireless communication technologies. The Internet is an example of thecommunication network 204 that constitutes and Internet Protocol (IP) network consisting of many computers, computing networks, and other communication devices located all over the world, which are connected through many telephone systems and other means. Other examples of thecommunication network 204 include, without limitation, a standard Plain Old Telephone System (POTS), an Integrated Services Digital Network (ISDN), the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Voice over Internet Protocol (VoIP) network, a Session Initiation Protocol (SIP) network, a cellular network, and any other type of packet-switched or circuit-switched network known in the art. In addition, it can be appreciated that thecommunication network 204 need not be limited to any one network type, and instead may be comprised of a number of different networks and/or network types. As one example, embodiments of the present disclosure may be utilized to increase the efficiency of a grid-based contact center. Examples of a grid-based contact center are more fully described in U.S. patent application Ser. No. 12/469,523 to Steiner, the entire contents of which are hereby incorporated herein by reference. Moreover, thecommunication network 204 may comprise a number of different communication media such as coaxial cable, copper cable/wire, fiber-optic cable, antennas for transmitting/receiving wireless messages, and combinations thereof. - The
communication devices 208 may correspond to customer communication devices. In accordance with at least some embodiments of the present disclosure, a customer may utilize theircommunication device 208 to initiate a work item, which is generally a request for aprocessing resource 212. Exemplary work items include, but are not limited to, a contact directed toward and received at a contact center, a web page request directed toward and received at a server farm (e.g., collection of servers), a media request, an application request (e.g., a request for application resources location on a remote application server, such as a SIP application server), and the like. The work item may be in the form of a message or collection of messages transmitted over thecommunication network 204. For example, the work item may be transmitted as a telephone call, a packet or collection of packets (e.g., IP packets transmitted over an IP network), an email message, an Instant Message, an SMS message, a fax, and combinations thereof. - The
work assignment mechanism 216 may employ any queue-based or queueless work assignment algorithm. Examples of queue-based work assignment skill-based algorithms include, without limitation, a fairness algorithm, pacing algorithm (which inserts rests into the agents work queue), value-based algorithms, limited algorithms (such as Business Advocate™ by Avaya, Inc.), and outsourcing algorithms. Other algorithms may consider other types of data inputs and/or may treat certain data inputs differently. - The format of the work item may depend upon the capabilities of the
communication device 208 and the format of the communication. In particular, work items are logical representations within a contact center of work to be performed in connection with servicing a communication received at the contact center (and more specifically the work assignment mechanism 216). The communication may be received and maintained at thework assignment mechanism 216, a switch or server connected to thework assignment mechanism 216, or the like until aresource 212 is assigned to the work item representing that communication at which point thework assignment mechanism 216 passes the work item to arouting engine 224 to connect thecommunication device 208 to the assignedresource 212. - Although the
routing engine 224 is depicted as being separate from thework assignment mechanism 216, therouting engine 224 may be incorporated into thework assignment mechanism 216 or its functionality may be executed by thework assignment engine 220. - In accordance with at least some embodiments of the present disclosure, the
communication devices 208 may comprise any type of known communication equipment or collection of communication equipment. Examples of asuitable communication device 208 include, but are not limited to, a personal computer, laptop, tablet, cellular phone, smartphone, telephone, or combinations thereof. In general, eachcommunication device 208 may be adapted to support video, audio, text, and/or data communications withother communication devices 208 as well as theprocessing resources 212. The type of medium used by thecommunication device 208 to communicate withother communication devices 208 or processingresources 212 may depend upon the communication applications available on thecommunication device 208. - In accordance with at least some embodiments of the present disclosure, the work item can be sent toward a collection of processing
resources 212 via the combined efforts of thework assignment mechanism 216 androuting engine 224. Theresources 212 can either be completely automated resources (e.g., Interactive Voice Response (IVR) units, processors, servers, or the like), human resources utilizing communication devices (e.g., human agents utilizing a computer, telephone, laptop, etc.), or any other resource known to be used in contact centers. - As discussed above, the
work assignment mechanism 216 andresources 212 may be owned and operated by a common entity in a contact center format. In some embodiments, thework assignment mechanism 216 may be administered by multiple enterprises, each of which has their owndedicated resources 212 a-n connected to thework assignment mechanism 216. - In some embodiments, the
work assignment mechanism 216 comprises awork assignment engine 220 which enables thework assignment mechanism 216 to make intelligent routing decisions for work items. In some embodiments, thework assignment engine 220 may be configured to administer and make work assignment decisions in a queueless contact center, as is described in U.S. patent application Ser. No. 12/882,950, to Flockhart et al, the entire contents of which are hereby incorporated herein by reference. - More specifically, the
work assignment engine 220 can determine which of the plurality ofprocessing resources 212 is qualified and/or eligible to receive the work item and further determine which of the plurality ofprocessing resources 212 is best suited (or is the optimal processing resource) to handle the processing needs of the work item. In situations of work item surplus, thework assignment engine 220 can also make the opposite determination (i.e., determine optimal assignment of a work item resource to a resource). In some embodiments, thework assignment engine 220 can be configured to achieve true one-to-one matching by utilizing bitmaps/tables and other data structures. - In accordance with at least some embodiments of the present disclosure, an
agent scripter 228 comprises a web-based user interface that provides theresource 212 with contextual information for consistency in dealing with customers. More specifically, theagent scripter 228 can evaluate a dialog 104 received from thecommunication network 204 from acustomer communication device 208. Information provided by theagent scripter 228 can be used by thework assignment engine 220 to assistresources 212 as questions are received in the form of dialogs 104 a-n. -
FIG. 3 illustrates an example of a request from a customer to a website requiring the services of the semantic translation model training system. Therequest process 300 may include, in some embodiments, acustomer communication device 208 connected via the Internet to one ormore web servers 308, which may be owned and operated by an enterprise administering a contact center in which atranslation module 108, adatabase server 312, and adatabase 316 operable to set up a session to handle incoming requests and queries from thecustomer communication device 208. - For example, the
customer 304 may have a question for a company. Thecustomer 304 may choose to check a website through acustomer communication device 208 connected to aweb server 308. The session begins with abrowser request 320 from thecustomer 304. Theweb server 308 can determine the desired language from thebrowser request 320. Thelanguage request 324 may be sent to atranslation module 108 for analysis. If thelanguage request 324 is in a first language, thetranslation module 108 may query 328 adatabase 316 for display information requested by the page. If thelanguage request 324 is in a second language, thetranslation module 108 may initiate alanguage query 328, potentially causing the semantic translation model training system to create a new language model. - In an example scenario, a
customer 304 in Ankara may wish to read through a Frequently Asked Questions (FAQ) page provided by a company. The company may be located in the United States, and as such, the FAQ page would typically be published in English. Thecustomer 304 may initiate abrowser request 320 for the FAQ page to be displayed in Turkish. Thelanguage request 324 may be forwarded to thetranslation module 108 if a new language model is needed. If the language model for Turkish has been created previously, the page may be returned to theweb server 308 for display at thecustomer communication device 208 in Turkish. - The
translation module 108 may perform a segmentation using thesegmentation application 112, a semantic analysis using thesemantic analyzer 116, and a syntactic analysis using thesyntactic analyzer 120 in conjunction with adata server 312. Thetranslation module 108 can automatically analyze the content and structure of the FAQ question and answer pairs if a language model for Turkish does not yet exist. Based on segmentation, analysis, keywords, grammar, and language rules in the English language model, the semantic translation model training system may create a Turkish language model by initiating adatabase lookup 332 for keywords, grammar, and language rules and creating a display of the FAQ question and answer pairs in Turkish for thecustomer 304. If a second customer in Ankara requests the FAQ page in Turkish, the model may provide the translation with adatabase lookup 332 since the model for Turkish already exists. If a third customer in Lima, Peru, sends abrowser request 320 for the FAQ page to be displayed in Spanish, the model may create a model and a translation based on the existing language models and known question and answer pairs in the first language (English) and the second language (Turkish). - With reference now to
FIG. 4 , aspects of amethod 400 for creating and storing question and answer pairs in accordance with embodiments of the present disclosure are depicted. Generally, themethod 400 begins with astart operation 404 and terminates with anend operation 440. While a general order for the steps of themethod 400 are shown inFIG. 4 , themethod 400 can include more or fewer steps or the order of the steps can be arranged differently than those shown inFIG. 4 . Themethod 400 can be executed as a set of computer-executable instructions executed by a computer system and encoded or stored on a computer readable medium. Further, the method may also be embodied by a set of gates or other structures in an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other configurable hardware component, module, or system. Hereinafter, themethod 400 shall be explained with reference to the systems, components, modules, software, data structures, etc. described in conjunction withFIGS. 1-3 . - Typically, the process idles at
step 404 until a dialog 104 has been received, instep 408. Instep 412, thetranslation module 108 may determine a language of the dialog 104. Once the language of the dialog 104 has been established, thetranslation module 108 may determine if an answer to a question presented in the dialog 104 is available in the identified language, instep 416. If the answer to the question presented in the dialog 104 is available in the identified language, then the question may be paired with the answer, instep 420, based on adatabase lookup 332, query mechanism, or other technique to pair the question and the answer. The question and answer pair may be scanned for the identification of keywords by thetranslation module 108, instep 424. The question and answer pair may be stored for further use and/or translation instep 436. - If the answer to the question presented in the dialog 104 is not available in the identified language and/or no such answer currently exists in the dialog 104, the question presented in the dialog 104 may be sent to an agent for processing, in
step 428. Alternatively, an automatic search and discovery for the answer can be used forstep 428. Theagent 212 orcommunication system 200 may find an answer to the question presented in the dialog 104 and pair it with the question presented in the dialog 104, instep 432. The question and answer pair may be stored for further use and/or translation instep 436. Themethod 400 for creating and storing question and answer pairs ends, atstep 440. - The
method 500 for creating a language model in accordance with embodiments of the present disclosure is shown inFIG. 5 . Generally, themethod 500 begins with astart operation 504 and terminates with anend operation 552. While a general order for the steps of themethod 500 are shown inFIG. 5 , themethod 500 can include more or fewer steps or the order of the steps can be arranged differently than those shown inFIG. 5 . Themethod 500 can be executed as a set of computer-executable instructions executed by a computer system and encoded or stored on a computer readable medium. Further, the method may also be embodied by a set of gates or other structures in an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other configurable hardware component, module, or system. Hereinafter, themethod 500 shall be explained with reference to the systems, components, modules, software, data structures, etc. described in conjunction withFIGS. 1-4 . - Typically, the process idles at
step 504 until a dialog 104 has been received, instep 508. Dialog segment patterns may be identified and separated for analysis by thesegmentation application 112 in thetranslation module 108, instep 512. Thedialog 104 a in the form of a first language may be semantically and/or structurally translated instep 512 by thesemantic analyzer 116 in thetranslation module 108. Semantic analysis typically includes the ability to analyze core meaning, including identification of a subject, verb, or object. Segments may also be identified at a topic and/or domain level. Vocabulary, grammar, and other characteristics may be identified through the semantic content analysis. It is at the semantic level where the question may be translated to the target language based on rules and word usage. - Syntactic analysis in
step 512 by thesyntactic analyzer 120 in thetranslation module 108 can involve parsing, or breaking down, the dialog segment 104 into its component parts of speech with an explanation of the form, function, and relationship between the components. Syntactic analysis may involve working the words into proper combinations using the results of the semantic analysis. The product of the analyses may be used to automatically generate the training materials, including an intermediate representation of the keyword translations, for the second language. Thedialog 104 a in the form of a first language may be concurrently translated, instep 516. - The semantic translation model training system may automatically combine the semantic/structural translation and the topic and/or domain words, phrases, constructs, and the first language translation and then apply linguistic rules, in
step 520. The representative translation is used to map the dialog 104 from a base language to another language, thereby creating a new language model, instep 524. - In
step 528, after the new model has been created, a determination is made as to whether or not an answer exists for the question present in the dialog 104. If the answer to the query is yes, then the question from the dialog 104 may be paired with the answer, instep 532. Within the question and answer pair, keywords may be identified and/or marked, instep 536. If the answer to the query is no, then the question from the dialog 104 may be sent to an agent and/orcommunication system resource 212, instep 540. Once the agent and/orcommunication resource 212 finds or creates an answer to the question in the dialog 104, the agent and/orcommunication resource 212 may create a new question and answer pair, instep 544. The output ofsteps step 548. Atstep 552, the process ends. - An embodiment of
semantic translation data 600 is shown inFIG. 6 . The phrase “semantic translation data,” as used herein, refers to a collection of information from question and answer analysis that may be stored by an organization and displayed upon request. Semantic translation data can include, but is not limited to, language information, a keyword, a question and answer pair, information from a structural translation, linguistic rules, and models for target languages. - The
semantic translation data 600 may include specific information from interactions with a third party, a direct customer of the contact center, or other users of the semantic translation model through a browser or other system mechanism. Thesemantic translation data 600 may include metadata. The metadata may include information on the user's language 604. It may also include a keyword 608 that may be associated with a communication that is to be translated. The database information may include the question andanswer pair 612 from the dialog 104. Thestructural translation field 616 can include one or more words translated by the model. Thelinguistic rules 620 may include grammar or structural guidelines for the target language. Themodel field 624 may include information including semantic analysis and syntactic analysis data for models that have been created. - If a model is created for a second language using the
semantic translation data 600, the stored information may include communication and context information important in a response to a request for an FAQ display and/or a query in a chat session. The response display and/or message may be provided by the contact center and may be automatically sent or sent by ahuman agent resource 112. Information from thedatabase 316 may also include question and answer information that has been collected in response to multiple interactions with a company or a contact center. While there are only sixinput fields FIG. 6 , there may be more or fewer data fields associated withdata structure 600. - Although the present disclosure describes components and functions implemented in the aspects, embodiments, and/or configurations with reference to particular standards and protocols, the aspects, embodiments, and/or configurations are not limited to such standards and protocols. Other similar standards and protocols not mentioned herein are in existence and are considered to be included in the present disclosure. Moreover, the standards and protocols mentioned herein and other similar standards and protocols not mentioned herein are periodically superseded by faster or more effective equivalents having essentially the same functions. Such replacement standards and protocols having the same functions are considered equivalents included in the present disclosure.
- The foregoing discussion has been presented for purposes of illustration and description. The foregoing is not intended to limit the disclosure to the form or forms disclosed herein. In the foregoing Detailed Description for example, various features of the disclosure are grouped together in one or more aspects, embodiments, and/or configurations for the purpose of streamlining the disclosure. The features of the aspects, embodiments, and/or configurations of the disclosure may be combined in alternate aspects, embodiments, and/or configurations other than those discussed above. This method of disclosure is not to be interpreted as reflecting an intention that the claims require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed aspect, embodiment, and/or configuration. Thus, the following claims are hereby incorporated into this Detailed Description, with each claim standing on its own as a separate preferred embodiment of the disclosure.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/929,090 US10599765B2 (en) | 2013-06-27 | 2013-06-27 | Semantic translation model training |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/929,090 US10599765B2 (en) | 2013-06-27 | 2013-06-27 | Semantic translation model training |
Publications (2)
Publication Number | Publication Date |
---|---|
US20150006143A1 true US20150006143A1 (en) | 2015-01-01 |
US10599765B2 US10599765B2 (en) | 2020-03-24 |
Family
ID=52116439
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/929,090 Active 2038-04-04 US10599765B2 (en) | 2013-06-27 | 2013-06-27 | Semantic translation model training |
Country Status (1)
Country | Link |
---|---|
US (1) | US10599765B2 (en) |
Cited By (56)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150193429A1 (en) * | 2014-01-09 | 2015-07-09 | International Business Machines Corporation | Automatic Generation of Question-Answer Pairs from Conversational Text |
WO2016131260A1 (en) * | 2015-07-15 | 2016-08-25 | 中兴通讯股份有限公司 | Word processing method and apparatus |
US20170185583A1 (en) * | 2015-12-28 | 2017-06-29 | Facebook, Inc. | Language model personalization |
US9715496B1 (en) | 2016-07-08 | 2017-07-25 | Asapp, Inc. | Automatically responding to a request of a user |
US9740687B2 (en) | 2014-06-11 | 2017-08-22 | Facebook, Inc. | Classifying languages for objects and entities |
US9805029B2 (en) | 2015-12-28 | 2017-10-31 | Facebook, Inc. | Predicting future translations |
US9830386B2 (en) | 2014-12-30 | 2017-11-28 | Facebook, Inc. | Determining trending topics in social media |
US9830404B2 (en) | 2014-12-30 | 2017-11-28 | Facebook, Inc. | Analyzing language dependency structures |
US9864744B2 (en) | 2014-12-03 | 2018-01-09 | Facebook, Inc. | Mining multi-lingual data |
US9899020B2 (en) | 2015-02-13 | 2018-02-20 | Facebook, Inc. | Machine learning dialect identification |
US9959271B1 (en) | 2015-09-28 | 2018-05-01 | Amazon Technologies, Inc. | Optimized statistical machine translation system with rapid adaptation capability |
US10015124B2 (en) * | 2016-09-20 | 2018-07-03 | Google Llc | Automatic response suggestions based on images received in messaging applications |
US10067936B2 (en) | 2014-12-30 | 2018-09-04 | Facebook, Inc. | Machine translation output reranking |
US10083451B2 (en) | 2016-07-08 | 2018-09-25 | Asapp, Inc. | Using semantic processing for customer support |
US10089299B2 (en) | 2015-12-17 | 2018-10-02 | Facebook, Inc. | Multi-media context language processing |
US10109275B2 (en) | 2016-12-19 | 2018-10-23 | Asapp, Inc. | Word hash language model |
US10133738B2 (en) | 2015-12-14 | 2018-11-20 | Facebook, Inc. | Translation confidence scores |
US10146768B2 (en) | 2017-01-25 | 2018-12-04 | Google Llc | Automatic suggested responses to images received in messages using language model |
US10185713B1 (en) * | 2015-09-28 | 2019-01-22 | Amazon Technologies, Inc. | Optimized statistical machine translation system with rapid adaptation capability |
US10210244B1 (en) | 2018-02-12 | 2019-02-19 | Asapp, Inc. | Updating natural language interfaces by processing usage data |
US10268684B1 (en) | 2015-09-28 | 2019-04-23 | Amazon Technologies, Inc. | Optimized statistical machine translation system with rapid adaptation capability |
US10289681B2 (en) | 2015-12-28 | 2019-05-14 | Facebook, Inc. | Predicting future translations |
US10348658B2 (en) | 2017-06-15 | 2019-07-09 | Google Llc | Suggested items for use with embedded applications in chat conversations |
US10346537B2 (en) | 2015-09-22 | 2019-07-09 | Facebook, Inc. | Universal translation |
US10380249B2 (en) | 2017-10-02 | 2019-08-13 | Facebook, Inc. | Predicting future trending topics |
US10387461B2 (en) | 2016-08-16 | 2019-08-20 | Google Llc | Techniques for suggesting electronic messages based on user activity and other context |
US10404636B2 (en) | 2017-06-15 | 2019-09-03 | Google Llc | Embedded programs and interfaces for chat conversations |
US10416846B2 (en) | 2016-11-12 | 2019-09-17 | Google Llc | Determining graphical element(s) for inclusion in an electronic communication |
US10489792B2 (en) | 2018-01-05 | 2019-11-26 | Asapp, Inc. | Maintaining quality of customer support messages |
US10497004B2 (en) | 2017-12-08 | 2019-12-03 | Asapp, Inc. | Automating communications using an intent classifier |
US10511450B2 (en) | 2016-09-20 | 2019-12-17 | Google Llc | Bot permissions |
US10530723B2 (en) | 2015-12-21 | 2020-01-07 | Google Llc | Automatic suggestions for message exchange threads |
US10547574B2 (en) | 2016-09-20 | 2020-01-28 | Google Llc | Suggested responses based on message stickers |
US10572516B2 (en) * | 2015-12-15 | 2020-02-25 | [24]7.ai, Inc. | Method and apparatus for managing natural language queries of customers |
US10650311B2 (en) | 2016-12-19 | 2020-05-12 | Asaap, Inc. | Suggesting resources using context hashing |
US10747957B2 (en) | 2018-11-13 | 2020-08-18 | Asapp, Inc. | Processing communications using a prototype classifier |
US10757043B2 (en) | 2015-12-21 | 2020-08-25 | Google Llc | Automatic suggestions and other content for messaging applications |
US10762423B2 (en) | 2017-06-27 | 2020-09-01 | Asapp, Inc. | Using a neural network to optimize processing of user requests |
US10796093B2 (en) | 2006-08-08 | 2020-10-06 | Elastic Minds, Llc | Automatic generation of statement-response sets from conversational text using natural language processing |
US10831999B2 (en) * | 2019-02-26 | 2020-11-10 | International Business Machines Corporation | Translation of ticket for resolution |
US10860854B2 (en) | 2017-05-16 | 2020-12-08 | Google Llc | Suggested actions for images |
US10878181B2 (en) | 2018-04-27 | 2020-12-29 | Asapp, Inc. | Removing personal information from text using a neural network |
US10891526B2 (en) | 2017-12-22 | 2021-01-12 | Google Llc | Functional image archiving |
US10902215B1 (en) | 2016-06-30 | 2021-01-26 | Facebook, Inc. | Social hash for language models |
US10902221B1 (en) | 2016-06-30 | 2021-01-26 | Facebook, Inc. | Social hash for language models |
CN113111666A (en) * | 2021-04-07 | 2021-07-13 | 北京沃东天骏信息技术有限公司 | System and method for realizing multi-language translation of application program |
JP2021131826A (en) * | 2020-02-21 | 2021-09-09 | 株式会社Pid | Information retrieval system, information retrieval program, and information retrieval method |
US11216510B2 (en) | 2018-08-03 | 2022-01-04 | Asapp, Inc. | Processing an incomplete message with a neural network to generate suggested messages |
US11341174B2 (en) * | 2017-03-24 | 2022-05-24 | Microsoft Technology Licensing, Llc | Voice-based knowledge sharing application for chatbots |
US11425064B2 (en) | 2019-10-25 | 2022-08-23 | Asapp, Inc. | Customized message suggestion with user embedding vectors |
US20220292254A1 (en) * | 2021-03-15 | 2022-09-15 | Avaya Management L.P. | Systems and methods for processing and displaying messages in digital communications |
US20220328063A1 (en) * | 2021-04-08 | 2022-10-13 | Jpmorgan Chase Bank, N.A. | Method and system for sentiment analysis of natural language inputs |
US11551004B2 (en) | 2018-11-13 | 2023-01-10 | Asapp, Inc. | Intent discovery with a prototype classifier |
US11836454B2 (en) | 2018-05-02 | 2023-12-05 | Language Scientific, Inc. | Systems and methods for producing reliable translation in near real-time |
US11916852B1 (en) * | 2015-12-11 | 2024-02-27 | Uipco, Llc | Open conversation user interface |
US12235889B2 (en) | 2022-08-26 | 2025-02-25 | Google Llc | Device messages provided in displayed image compilations based on user content |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020023144A1 (en) * | 2000-06-06 | 2002-02-21 | Linyard Ronald A. | Method and system for providing electronic user assistance |
US20050105712A1 (en) * | 2003-02-11 | 2005-05-19 | Williams David R. | Machine learning |
US20060078862A1 (en) * | 2004-09-27 | 2006-04-13 | Kabushiki Kaisha Toshiba | Answer support system, answer support apparatus, and answer support program |
US20070118519A1 (en) * | 2005-11-21 | 2007-05-24 | Fuji Xerox Co., Ltd. | Question answering system, data search method, and computer program |
US20080195378A1 (en) * | 2005-02-08 | 2008-08-14 | Nec Corporation | Question and Answer Data Editing Device, Question and Answer Data Editing Method and Question Answer Data Editing Program |
US20090186330A1 (en) * | 2008-01-19 | 2009-07-23 | International Business Machines Corporation | Reusable ad hoc self-posed questions and answers for social network profiles |
US20100076998A1 (en) * | 2008-09-11 | 2010-03-25 | Intuit Inc. | Method and system for generating a dynamic help document |
US20110125734A1 (en) * | 2009-11-23 | 2011-05-26 | International Business Machines Corporation | Questions and answers generation |
US20110153312A1 (en) * | 2007-10-23 | 2011-06-23 | Thomas Roberts | Method and computer system for automatically answering natural language questions |
US20130073276A1 (en) * | 2011-09-19 | 2013-03-21 | Nuance Communications, Inc. | MT Based Spoken Dialog Systems Customer/Machine Dialog |
US8412514B1 (en) * | 2005-10-27 | 2013-04-02 | At&T Intellectual Property Ii, L.P. | Method and apparatus for compiling and querying a QA database |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101130457B1 (en) | 2004-11-04 | 2012-03-28 | 마이크로소프트 코포레이션 | Extracting treelet translation pairs |
-
2013
- 2013-06-27 US US13/929,090 patent/US10599765B2/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020023144A1 (en) * | 2000-06-06 | 2002-02-21 | Linyard Ronald A. | Method and system for providing electronic user assistance |
US20050105712A1 (en) * | 2003-02-11 | 2005-05-19 | Williams David R. | Machine learning |
US20060078862A1 (en) * | 2004-09-27 | 2006-04-13 | Kabushiki Kaisha Toshiba | Answer support system, answer support apparatus, and answer support program |
US20080195378A1 (en) * | 2005-02-08 | 2008-08-14 | Nec Corporation | Question and Answer Data Editing Device, Question and Answer Data Editing Method and Question Answer Data Editing Program |
US8412514B1 (en) * | 2005-10-27 | 2013-04-02 | At&T Intellectual Property Ii, L.P. | Method and apparatus for compiling and querying a QA database |
US20070118519A1 (en) * | 2005-11-21 | 2007-05-24 | Fuji Xerox Co., Ltd. | Question answering system, data search method, and computer program |
US20110153312A1 (en) * | 2007-10-23 | 2011-06-23 | Thomas Roberts | Method and computer system for automatically answering natural language questions |
US20090186330A1 (en) * | 2008-01-19 | 2009-07-23 | International Business Machines Corporation | Reusable ad hoc self-posed questions and answers for social network profiles |
US20100076998A1 (en) * | 2008-09-11 | 2010-03-25 | Intuit Inc. | Method and system for generating a dynamic help document |
US20110125734A1 (en) * | 2009-11-23 | 2011-05-26 | International Business Machines Corporation | Questions and answers generation |
US20130073276A1 (en) * | 2011-09-19 | 2013-03-21 | Nuance Communications, Inc. | MT Based Spoken Dialog Systems Customer/Machine Dialog |
Cited By (95)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11138375B2 (en) | 2006-08-08 | 2021-10-05 | Scorpcast, Llc | Automatic generation of statement-response sets from conversational text using natural language processing |
US11361160B2 (en) | 2006-08-08 | 2022-06-14 | Scorpcast, Llc | Automatic generation of statement-response sets from conversational text using natural language processing |
US10796093B2 (en) | 2006-08-08 | 2020-10-06 | Elastic Minds, Llc | Automatic generation of statement-response sets from conversational text using natural language processing |
US11334718B2 (en) | 2006-08-08 | 2022-05-17 | Scorpcast, Llc | Automatic generation of statement-response sets from conversational text using natural language processing |
US9348817B2 (en) * | 2014-01-09 | 2016-05-24 | International Business Machines Corporation | Automatic generation of question-answer pairs from conversational text |
US20150193429A1 (en) * | 2014-01-09 | 2015-07-09 | International Business Machines Corporation | Automatic Generation of Question-Answer Pairs from Conversational Text |
US10002131B2 (en) | 2014-06-11 | 2018-06-19 | Facebook, Inc. | Classifying languages for objects and entities |
US9740687B2 (en) | 2014-06-11 | 2017-08-22 | Facebook, Inc. | Classifying languages for objects and entities |
US10013417B2 (en) | 2014-06-11 | 2018-07-03 | Facebook, Inc. | Classifying languages for objects and entities |
US9864744B2 (en) | 2014-12-03 | 2018-01-09 | Facebook, Inc. | Mining multi-lingual data |
US9830404B2 (en) | 2014-12-30 | 2017-11-28 | Facebook, Inc. | Analyzing language dependency structures |
US9830386B2 (en) | 2014-12-30 | 2017-11-28 | Facebook, Inc. | Determining trending topics in social media |
US10067936B2 (en) | 2014-12-30 | 2018-09-04 | Facebook, Inc. | Machine translation output reranking |
US9899020B2 (en) | 2015-02-13 | 2018-02-20 | Facebook, Inc. | Machine learning dialect identification |
WO2016131260A1 (en) * | 2015-07-15 | 2016-08-25 | 中兴通讯股份有限公司 | Word processing method and apparatus |
US10346537B2 (en) | 2015-09-22 | 2019-07-09 | Facebook, Inc. | Universal translation |
US9959271B1 (en) | 2015-09-28 | 2018-05-01 | Amazon Technologies, Inc. | Optimized statistical machine translation system with rapid adaptation capability |
US10268684B1 (en) | 2015-09-28 | 2019-04-23 | Amazon Technologies, Inc. | Optimized statistical machine translation system with rapid adaptation capability |
US10185713B1 (en) * | 2015-09-28 | 2019-01-22 | Amazon Technologies, Inc. | Optimized statistical machine translation system with rapid adaptation capability |
US11916852B1 (en) * | 2015-12-11 | 2024-02-27 | Uipco, Llc | Open conversation user interface |
US12184591B1 (en) * | 2015-12-11 | 2024-12-31 | Uipco, Llc | Open conversation user interface |
US10133738B2 (en) | 2015-12-14 | 2018-11-20 | Facebook, Inc. | Translation confidence scores |
US10572516B2 (en) * | 2015-12-15 | 2020-02-25 | [24]7.ai, Inc. | Method and apparatus for managing natural language queries of customers |
US10089299B2 (en) | 2015-12-17 | 2018-10-02 | Facebook, Inc. | Multi-media context language processing |
US10757043B2 (en) | 2015-12-21 | 2020-08-25 | Google Llc | Automatic suggestions and other content for messaging applications |
US10530723B2 (en) | 2015-12-21 | 2020-01-07 | Google Llc | Automatic suggestions for message exchange threads |
US11502975B2 (en) | 2015-12-21 | 2022-11-15 | Google Llc | Automatic suggestions and other content for messaging applications |
US11418471B2 (en) | 2015-12-21 | 2022-08-16 | Google Llc | Automatic suggestions for message exchange threads |
US20170185583A1 (en) * | 2015-12-28 | 2017-06-29 | Facebook, Inc. | Language model personalization |
US10540450B2 (en) | 2015-12-28 | 2020-01-21 | Facebook, Inc. | Predicting future translations |
US10289681B2 (en) | 2015-12-28 | 2019-05-14 | Facebook, Inc. | Predicting future translations |
US10002125B2 (en) * | 2015-12-28 | 2018-06-19 | Facebook, Inc. | Language model personalization |
US9805029B2 (en) | 2015-12-28 | 2017-10-31 | Facebook, Inc. | Predicting future translations |
US10902221B1 (en) | 2016-06-30 | 2021-01-26 | Facebook, Inc. | Social hash for language models |
US10902215B1 (en) | 2016-06-30 | 2021-01-26 | Facebook, Inc. | Social hash for language models |
US11615422B2 (en) | 2016-07-08 | 2023-03-28 | Asapp, Inc. | Automatically suggesting completions of text |
US10453074B2 (en) | 2016-07-08 | 2019-10-22 | Asapp, Inc. | Automatically suggesting resources for responding to a request |
US9807037B1 (en) * | 2016-07-08 | 2017-10-31 | Asapp, Inc. | Automatically suggesting completions of text |
US9805371B1 (en) | 2016-07-08 | 2017-10-31 | Asapp, Inc. | Automatically suggesting responses to a received message |
US10387888B2 (en) | 2016-07-08 | 2019-08-20 | Asapp, Inc. | Assisting entities in responding to a request of a user |
US9715496B1 (en) | 2016-07-08 | 2017-07-25 | Asapp, Inc. | Automatically responding to a request of a user |
US10733614B2 (en) | 2016-07-08 | 2020-08-04 | Asapp, Inc. | Assisting entities in responding to a request of a user |
US10535071B2 (en) | 2016-07-08 | 2020-01-14 | Asapp, Inc. | Using semantic processing for customer support |
US10083451B2 (en) | 2016-07-08 | 2018-09-25 | Asapp, Inc. | Using semantic processing for customer support |
US11790376B2 (en) | 2016-07-08 | 2023-10-17 | Asapp, Inc. | Predicting customer support requests |
US12039545B2 (en) | 2016-07-08 | 2024-07-16 | Asapp, Inc. | Third-party service for suggesting a response to a received message |
US10387461B2 (en) | 2016-08-16 | 2019-08-20 | Google Llc | Techniques for suggesting electronic messages based on user activity and other context |
US10547574B2 (en) | 2016-09-20 | 2020-01-28 | Google Llc | Suggested responses based on message stickers |
US10979373B2 (en) | 2016-09-20 | 2021-04-13 | Google Llc | Suggested responses based on message stickers |
US10015124B2 (en) * | 2016-09-20 | 2018-07-03 | Google Llc | Automatic response suggestions based on images received in messaging applications |
US12126739B2 (en) | 2016-09-20 | 2024-10-22 | Google Llc | Bot permissions |
US10412030B2 (en) * | 2016-09-20 | 2019-09-10 | Google Llc | Automatic response suggestions based on images received in messaging applications |
US10511450B2 (en) | 2016-09-20 | 2019-12-17 | Google Llc | Bot permissions |
US11336467B2 (en) | 2016-09-20 | 2022-05-17 | Google Llc | Bot permissions |
US10862836B2 (en) | 2016-09-20 | 2020-12-08 | Google Llc | Automatic response suggestions based on images received in messaging applications |
US11303590B2 (en) | 2016-09-20 | 2022-04-12 | Google Llc | Suggested responses based on message stickers |
US11700134B2 (en) | 2016-09-20 | 2023-07-11 | Google Llc | Bot permissions |
US10416846B2 (en) | 2016-11-12 | 2019-09-17 | Google Llc | Determining graphical element(s) for inclusion in an electronic communication |
US10482875B2 (en) | 2016-12-19 | 2019-11-19 | Asapp, Inc. | Word hash language model |
US10650311B2 (en) | 2016-12-19 | 2020-05-12 | Asaap, Inc. | Suggesting resources using context hashing |
US10109275B2 (en) | 2016-12-19 | 2018-10-23 | Asapp, Inc. | Word hash language model |
US10146768B2 (en) | 2017-01-25 | 2018-12-04 | Google Llc | Automatic suggested responses to images received in messages using language model |
US11341174B2 (en) * | 2017-03-24 | 2022-05-24 | Microsoft Technology Licensing, Llc | Voice-based knowledge sharing application for chatbots |
US11574470B2 (en) | 2017-05-16 | 2023-02-07 | Google Llc | Suggested actions for images |
US10860854B2 (en) | 2017-05-16 | 2020-12-08 | Google Llc | Suggested actions for images |
US10891485B2 (en) | 2017-05-16 | 2021-01-12 | Google Llc | Image archival based on image categories |
US10880243B2 (en) | 2017-06-15 | 2020-12-29 | Google Llc | Embedded programs and interfaces for chat conversations |
US10348658B2 (en) | 2017-06-15 | 2019-07-09 | Google Llc | Suggested items for use with embedded applications in chat conversations |
US11451499B2 (en) | 2017-06-15 | 2022-09-20 | Google Llc | Embedded programs and interfaces for chat conversations |
US11050694B2 (en) | 2017-06-15 | 2021-06-29 | Google Llc | Suggested items for use with embedded applications in chat conversations |
US10404636B2 (en) | 2017-06-15 | 2019-09-03 | Google Llc | Embedded programs and interfaces for chat conversations |
US10762423B2 (en) | 2017-06-27 | 2020-09-01 | Asapp, Inc. | Using a neural network to optimize processing of user requests |
US10380249B2 (en) | 2017-10-02 | 2019-08-13 | Facebook, Inc. | Predicting future trending topics |
US12014379B2 (en) | 2017-12-08 | 2024-06-18 | Asapp, Inc. | Automating communications using an intent classifier |
US10497004B2 (en) | 2017-12-08 | 2019-12-03 | Asapp, Inc. | Automating communications using an intent classifier |
US10891526B2 (en) | 2017-12-22 | 2021-01-12 | Google Llc | Functional image archiving |
US11829404B2 (en) | 2017-12-22 | 2023-11-28 | Google Llc | Functional image archiving |
US10489792B2 (en) | 2018-01-05 | 2019-11-26 | Asapp, Inc. | Maintaining quality of customer support messages |
US10210244B1 (en) | 2018-02-12 | 2019-02-19 | Asapp, Inc. | Updating natural language interfaces by processing usage data |
US10515104B2 (en) | 2018-02-12 | 2019-12-24 | Asapp, Inc. | Updating natural language interfaces by processing usage data |
US10878181B2 (en) | 2018-04-27 | 2020-12-29 | Asapp, Inc. | Removing personal information from text using a neural network |
US11386259B2 (en) | 2018-04-27 | 2022-07-12 | Asapp, Inc. | Removing personal information from text using multiple levels of redaction |
US11836454B2 (en) | 2018-05-02 | 2023-12-05 | Language Scientific, Inc. | Systems and methods for producing reliable translation in near real-time |
US11216510B2 (en) | 2018-08-03 | 2022-01-04 | Asapp, Inc. | Processing an incomplete message with a neural network to generate suggested messages |
US11551004B2 (en) | 2018-11-13 | 2023-01-10 | Asapp, Inc. | Intent discovery with a prototype classifier |
US10747957B2 (en) | 2018-11-13 | 2020-08-18 | Asapp, Inc. | Processing communications using a prototype classifier |
US10831999B2 (en) * | 2019-02-26 | 2020-11-10 | International Business Machines Corporation | Translation of ticket for resolution |
US11425064B2 (en) | 2019-10-25 | 2022-08-23 | Asapp, Inc. | Customized message suggestion with user embedding vectors |
JP2021131826A (en) * | 2020-02-21 | 2021-09-09 | 株式会社Pid | Information retrieval system, information retrieval program, and information retrieval method |
US11556696B2 (en) * | 2021-03-15 | 2023-01-17 | Avaya Management L.P. | Systems and methods for processing and displaying messages in digital communications |
US20220292254A1 (en) * | 2021-03-15 | 2022-09-15 | Avaya Management L.P. | Systems and methods for processing and displaying messages in digital communications |
CN113111666A (en) * | 2021-04-07 | 2021-07-13 | 北京沃东天骏信息技术有限公司 | System and method for realizing multi-language translation of application program |
US20220328063A1 (en) * | 2021-04-08 | 2022-10-13 | Jpmorgan Chase Bank, N.A. | Method and system for sentiment analysis of natural language inputs |
US12087322B2 (en) * | 2021-04-08 | 2024-09-10 | Jpmorgan Chase Bank, N.A. | Method and system for sentiment analysis of natural language inputs |
US12235889B2 (en) | 2022-08-26 | 2025-02-25 | Google Llc | Device messages provided in displayed image compilations based on user content |
Also Published As
Publication number | Publication date |
---|---|
US10599765B2 (en) | 2020-03-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10599765B2 (en) | Semantic translation model training | |
Nguyen et al. | NEU-chatbot: Chatbot for admission of National Economics University | |
Poongodi et al. | Chat-bot-based natural language interface for blogs and information networks | |
US10904200B2 (en) | Systems, apparatus, and methods for platform-agnostic message processing | |
US10827024B1 (en) | Realtime bandwidth-based communication for assistant systems | |
Lester et al. | Conversational agents | |
US11798539B2 (en) | Systems and methods relating to bot authoring by mining intents from conversation data via intent seeding | |
US10169490B2 (en) | Query disambiguation in a question-answering environment | |
US10621181B2 (en) | System and method for screening social media content | |
JP2023545947A6 (en) | Systems and methods for bot authoring by mining intent from conversation data via intent seeding | |
JP2023543032A6 (en) | Systems and methods for bot authoring by mining intent from natural language conversations | |
US20170004178A1 (en) | Reference validity checker | |
US11586940B2 (en) | Generating answers to text input in an electronic communication tool with a question answering system | |
US20200150780A1 (en) | Input method editor | |
EP3031030A1 (en) | Methods and apparatus for determining outcomes of on-line conversations and similar discourses through analysis of expressions of sentiment during the conversations | |
Kongthon et al. | Implementing an online help desk system based on conversational agent | |
Mabrouk et al. | A multilingual african embedding for FAQ chatbots | |
Ahed et al. | An enhanced twitter corpus for the classification of arabic speech acts | |
Steinmetz et al. | Conversational question answering using a shift of context | |
US11847416B2 (en) | Systems and methods for converting an input content item based on contexts | |
Alankritha et al. | A Study on Extractive Text Summarization via Speech Assistor using Phrase-Based Statistical Machine Translation | |
Alexandris | The CitizenShield dialogue system in multilingual applications | |
Accame et al. | Transliteration of Contact Names and/or Other Data Using an Automated Assistant | |
Alexandris | Controlling interaction in multilingual conversation | |
Brown | Small Talk: A web based tool to help users parse instant messages |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: AVAYA INC., NEW JERSEY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SKIBA, DAVID;ERHART, GEORGE;BECKER, LEE;AND OTHERS;SIGNING DATES FROM 20130615 TO 20130626;REEL/FRAME:030702/0437 |
|
AS | Assignment |
Owner name: CITIBANK, N.A., AS ADMINISTRATIVE AGENT, NEW YORK Free format text: SECURITY INTEREST;ASSIGNORS:AVAYA INC.;AVAYA INTEGRATED CABINET SOLUTIONS INC.;OCTEL COMMUNICATIONS CORPORATION;AND OTHERS;REEL/FRAME:041576/0001 Effective date: 20170124 |
|
STCV | Information on status: appeal procedure |
Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS |
|
AS | Assignment |
Owner name: OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL COMMUNICATIONS CORPORATION), CALIFORNIA Free format text: BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001;ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:044893/0531 Effective date: 20171128 Owner name: AVAYA INTEGRATED CABINET SOLUTIONS INC., CALIFORNIA Free format text: BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001;ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:044893/0531 Effective date: 20171128 Owner name: VPNET TECHNOLOGIES, INC., CALIFORNIA Free format text: BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001;ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:044893/0531 Effective date: 20171128 Owner name: OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL Free format text: BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001;ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:044893/0531 Effective date: 20171128 Owner name: AVAYA INC., CALIFORNIA Free format text: BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001;ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:044893/0531 Effective date: 20171128 Owner name: AVAYA INTEGRATED CABINET SOLUTIONS INC., CALIFORNI Free format text: BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001;ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:044893/0531 Effective date: 20171128 |
|
AS | Assignment |
Owner name: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT, NEW YORK Free format text: SECURITY INTEREST;ASSIGNORS:AVAYA INC.;AVAYA INTEGRATED CABINET SOLUTIONS LLC;OCTEL COMMUNICATIONS LLC;AND OTHERS;REEL/FRAME:045034/0001 Effective date: 20171215 Owner name: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT, NEW Y Free format text: SECURITY INTEREST;ASSIGNORS:AVAYA INC.;AVAYA INTEGRATED CABINET SOLUTIONS LLC;OCTEL COMMUNICATIONS LLC;AND OTHERS;REEL/FRAME:045034/0001 Effective date: 20171215 |
|
AS | Assignment |
Owner name: CITIBANK, N.A., AS COLLATERAL AGENT, NEW YORK Free format text: SECURITY INTEREST;ASSIGNORS:AVAYA INC.;AVAYA INTEGRATED CABINET SOLUTIONS LLC;OCTEL COMMUNICATIONS LLC;AND OTHERS;REEL/FRAME:045124/0026 Effective date: 20171215 |
|
STCV | Information on status: appeal procedure |
Free format text: BOARD OF APPEALS DECISION RENDERED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: WILMINGTON TRUST, NATIONAL ASSOCIATION, MINNESOTA Free format text: SECURITY INTEREST;ASSIGNORS:AVAYA INC.;AVAYA MANAGEMENT L.P.;INTELLISIST, INC.;AND OTHERS;REEL/FRAME:053955/0436 Effective date: 20200925 |
|
AS | Assignment |
Owner name: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT, DELAWARE Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT;ASSIGNORS:AVAYA INC.;INTELLISIST, INC.;AVAYA MANAGEMENT L.P.;AND OTHERS;REEL/FRAME:061087/0386 Effective date: 20220712 |
|
AS | Assignment |
Owner name: AVAYA INTEGRATED CABINET SOLUTIONS LLC, NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026;ASSIGNOR:CITIBANK, N.A., AS COLLATERAL AGENT;REEL/FRAME:063457/0001 Effective date: 20230403 Owner name: AVAYA MANAGEMENT L.P., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026;ASSIGNOR:CITIBANK, N.A., AS COLLATERAL AGENT;REEL/FRAME:063457/0001 Effective date: 20230403 Owner name: AVAYA INC., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026;ASSIGNOR:CITIBANK, N.A., AS COLLATERAL AGENT;REEL/FRAME:063457/0001 Effective date: 20230403 Owner name: AVAYA HOLDINGS CORP., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026;ASSIGNOR:CITIBANK, N.A., AS COLLATERAL AGENT;REEL/FRAME:063457/0001 Effective date: 20230403 |
|
AS | Assignment |
Owner name: WILMINGTON SAVINGS FUND SOCIETY, FSB (COLLATERAL AGENT), DELAWARE Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT;ASSIGNORS:AVAYA MANAGEMENT L.P.;AVAYA INC.;INTELLISIST, INC.;AND OTHERS;REEL/FRAME:063742/0001 Effective date: 20230501 |
|
AS | Assignment |
Owner name: CITIBANK, N.A., AS COLLATERAL AGENT, NEW YORK Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT;ASSIGNORS:AVAYA INC.;AVAYA MANAGEMENT L.P.;INTELLISIST, INC.;REEL/FRAME:063542/0662 Effective date: 20230501 |
|
AS | Assignment |
Owner name: AVAYA MANAGEMENT L.P., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: CAAS TECHNOLOGIES, LLC, NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: HYPERQUALITY II, LLC, NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: HYPERQUALITY, INC., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.), NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: VPNET TECHNOLOGIES, INC., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: OCTEL COMMUNICATIONS LLC, NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: AVAYA INTEGRATED CABINET SOLUTIONS LLC, NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: INTELLISIST, INC., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: AVAYA INC., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001);ASSIGNOR:GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT;REEL/FRAME:063779/0622 Effective date: 20230501 Owner name: AVAYA INTEGRATED CABINET SOLUTIONS LLC, NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436);ASSIGNOR:WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT;REEL/FRAME:063705/0023 Effective date: 20230501 Owner name: INTELLISIST, INC., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436);ASSIGNOR:WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT;REEL/FRAME:063705/0023 Effective date: 20230501 Owner name: AVAYA INC., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436);ASSIGNOR:WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT;REEL/FRAME:063705/0023 Effective date: 20230501 Owner name: AVAYA MANAGEMENT L.P., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436);ASSIGNOR:WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT;REEL/FRAME:063705/0023 Effective date: 20230501 Owner name: AVAYA INTEGRATED CABINET SOLUTIONS LLC, NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386);ASSIGNOR:WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT;REEL/FRAME:063690/0359 Effective date: 20230501 Owner name: INTELLISIST, INC., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386);ASSIGNOR:WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT;REEL/FRAME:063690/0359 Effective date: 20230501 Owner name: AVAYA INC., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386);ASSIGNOR:WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT;REEL/FRAME:063690/0359 Effective date: 20230501 Owner name: AVAYA MANAGEMENT L.P., NEW JERSEY Free format text: RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386);ASSIGNOR:WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT;REEL/FRAME:063690/0359 Effective date: 20230501 |
|
AS | Assignment |
Owner name: AVAYA LLC, DELAWARE Free format text: (SECURITY INTEREST) GRANTOR'S NAME CHANGE;ASSIGNOR:AVAYA INC.;REEL/FRAME:065019/0231 Effective date: 20230501 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
AS | Assignment |
Owner name: AVAYA MANAGEMENT L.P., NEW JERSEY Free format text: INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT;ASSIGNOR:WILMINGTON SAVINGS FUND SOCIETY, FSB;REEL/FRAME:066894/0227 Effective date: 20240325 Owner name: AVAYA LLC, DELAWARE Free format text: INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT;ASSIGNOR:WILMINGTON SAVINGS FUND SOCIETY, FSB;REEL/FRAME:066894/0227 Effective date: 20240325 Owner name: AVAYA MANAGEMENT L.P., NEW JERSEY Free format text: INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT;ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:066894/0117 Effective date: 20240325 Owner name: AVAYA LLC, DELAWARE Free format text: INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT;ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:066894/0117 Effective date: 20240325 |
|
AS | Assignment |
Owner name: ARLINGTON TECHNOLOGIES, LLC, TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAYA LLC;REEL/FRAME:067022/0780 Effective date: 20240329 |