International Business Machines Corporation (Armonk, NY)
What is a Patent for Method and system to enable contextually aware detection of offensive speech in video
Embodiments can be described as a method and system used to filter the speech of video. Speech in videos can contain offensive or profane words that need to be filtered. To ascertain whether a term or phrase is offensive, the contextual information from surrounding words and the contextual information from detected objects and scenes in the video are utilized. Words that are not wanted can be removed or collected and presented to the user.
The present application focuses on the method and system of filtering the speech of videos.
Speech can refer to words or phrases that are offensive, profane or otherwise offensive, vulgar or in any other way objectionable. The definition of what is objectionable differs from culture to culture, from language to language or between groups within the same culture, and among members of the same culture. In addition, terms or phrases that are considered objectionable in one context could be acceptable in a different context. Due to their many meanings, polysemantic terms are a problem. For instance, the term “bloody” in British English is considered an expletive that is objectionable. However, the word “bloody” is also used to describe blood loss such as that incurred by American baseball player Curt Schilling on his ankleduring Game 6 in the 2004 American League Championship Series, an incident which is often referred to as the “bloody sock.” The mention of Curt Schilling’s bloody sock is not considered to be profane or objectionable. It is difficult to detect offensive speech due to culture or language, context, individuals, and the differences in context.
The past was when speech filtering systems depended on lists of vulgar words that were kept in “dictionaries” to evaluate against the speech being filtering. These lists can be too broad and do not include certain words. This is especially difficult for polysemantic words, such as “bloody”. The above example illustrates how “bloody” is filtered to mean Curt Schilling’s socks, even though it’s not considered to be a profane word. Filtering “bloody” from the expression “bloody socks” is problematic since it eliminates an important piece of information that is valid and unobjectionable that results in a loss or meaning to the expression.
Video speech allows for better filtering of offensive phrases and words. It also gives the context of the speech by providing visual information about the scene where the speech is taking place. Photos of bloody socks during a baseball match could suggest that “bloody”, as an expletive is not being used. Traditional dictionary-based systems do not use video content to determine context. Another problem with conventionaldictionary systems is that they are relatively inflexible because they depend on a user updating the dictionary database of words. More flexible and contextually aware speech recognition systems that recognize speech in video are beneficial, as they provide moreaccurate filtering of offensive speech that blocks content, and at the same time allowing legitimate speech to be conveyed to the user/viewer.
Embodiments can provide a computer implemented method in a data processing system comprising a processor and a memory comprising instructions, which are executed by the processor to cause the processor implement speech filtration of a video, themethod comprising converting speech in a scene of the video to text, wherein the text comprises words; evaluating the text to determine candidate words to filter; for each identified candidate word: determining if there is a non-objectionable meaning tothe identified candidate word, and if there are no non-objectionable meanings to the identified candidate word, then filtering the candidate word from the speech; for each candidate word having at least one non-objectionable meaning: identifyingsurrounding words in the scene, calculating a first context for the candidate word using semantic analysis of the surrounding words, receiving a list of objects in the scene, calculating a second context for the candidate word using semantic analysis ofthe list of objects, determining if the candidate word is objectionable based on the first and second contexts, and if the candidate word is objectionable, then filtering the candidate word from the speech.
Embodiments also offer a method further comprising wherein the process of evaluating the text in order to determine potential words to filter is done by using a pre-filter to exclude words that are not designated as potential words.
Embodiments may also include removing punctuation.
Embodiments may also provide an additional method that incorporates the following: analyzing the text in order to determine candidate words to filter, determining the language of the text, choosing a dictionary based on the languageof the text and comparing each word to the dictionary selected.
Embodiments can also be an additional method of ensuring that the scene includes a portion that has a stop and start time.
Embodiments could also offer an additional method for the recognition of the surrounding words. This involves identifying the words that lie between the word being considered and the subject.
Embodiments can further provide a method further comprising wherein the semantic analysis is an analysis using deep learning.
Embodiments also offer a method further comprising wherein the objects in the scene comprise an image of textual description of a visual element.
Embodiments may also provide an option that includes filtering, which includes muting the voice.
Embodiments may also provide the opportunity to add each candidate word from the dictionary.
A computer-readable program can also be supplied that comprises the computer-readable medium along with a computer-readable program. The computer readable program is executed by a processor, causes the processor toperform various ones of, or combinations of, the operations that were described previously in connection with the method illustrative embodiment.
A system may also be provided in another embodiment. A persistent identification processor may be an element of the system. It may perform a variety of operations, as well as combinations, of those previously mentioned in relation to the method illustrated embodiment.
Additional features and advantages of the disclosed invention will become clear from the detailed description of the illustrative embodiments which proceeds with reference to the drawings that accompany it.
Click here to view the patent on USPTO website.
Get Patents with PatentPC
What is a patent?
A patent is granted by the government to safeguard an invention, patents grant the inventor with exclusive rights to create, use to sell, and promote the invention? Society benefits when a new technology is brought to the market. These benefits may be directly realized by people who are able to accomplish feats previously unattainable, or indirectly through the economic benefits that innovation offers (business expansion, jobs).
Many pharmaceutical firms and researchers from universities are seeking protection under patents to protect their research and development. Patents may cover an abstract or physical process or product, or even the method or composition of materials unique to the field. To be granted patent protection an invention has to be innovative, novel and not be obvious to others in the same field.
Patents give inventors a reward for commercially profitable inventions. They provide a motivation for inventors to come up with new ideas. Small companies and inventors can be certain that they will receive a return on the investment they make in technology advancement through patents. This means they will be able to make a living by their work.
Patents are a crucial part of companies, and they can:
Make sure you protect your unique products and services
Improve the value, the appearance, and visibility of your products on the market;
Differentiate your business and products from the competition;
Get technical and business information.
Beware of the possibility of accidentally using third-party proprietary content or losing valuable information, innovative outputs, or other creative output.
Patents effectively transform the inventor’s knowledge into a marketable asset which opens new opportunities for job creation and growth of business through licensing or joint ventures.
Investors in the development and commercialization of technology may find small companies with patent protection more appealing.
Patenting can lead to new ideas and inventions. This information could encourage creativity and could be eligible for patent protection.
Patents can be used to stop untrustworthy third-party companies from earning through the work of inventions.
Patent-protected technology revenue that is commercially profitable could be used to fund technological research and development (R&D) that will improve the chances of a better technology in the near future.
You can use intellectual property ownership to convince lenders and investors that your product has commercial value. Sometimes, a powerful patent could open the door to multiple financing options. Patents and other IP assets can be utilized as collateral or security for debt financing. Investors can also see your patent assets in order to increase their company valuation. Forbes and other publications have stated that each patent can increase company valuation by anywhere from $500,000 to $1 million.
Start-ups require a well-constructed business plan that leverages the IP to demonstrate that your product or service is unique and innovative, superior, or superior. Investors will be impressed if you have IP rights are secure or in the process to becoming secure, and if they agree with your business strategy.
It is vital to keep an invention secret prior to filing for patent protection. The public disclosure of an invention before it is filed can often destroy its novelty and render it unpatentable. Disclosures that are filed prior to filing, like for investors, test-marketing, or other business partners, should be done only after signing a confidentiality contract.
There are numerous types of patents. Understanding them is crucial for protecting your invention. Utility patents cover new techniques and machines. Design patents cover ornamental designs. Patents for utility are the most effective as they protect the owner from copycats as well as other competitors. Frequently the utility patent is issued for alterations or improvements to existing inventions. Patents issued under utility can be used to enhance or alter existing inventions. A process patent would describe the methods or actions of performing a specific act. But, a chemical composition will include an amalgamation of ingredients.
What’s the duration of a patent last? Although utility patents are valid up to 20 years from their earliest filing, they can be extended through delays in the patent office.
Do you want to protect your idea? Patents are granted only to applicants who are the first to file, which is why you need to file fast. Call PatentPC today to file your patent application approved!
A patent search is an essential step when you’re writing an application for patent. This will allow you to discover other concepts and provide insight into their potential. It will help you narrow down the nature of your invention. You can also learn about the technological advancements in your field of invention. You’ll have a better idea of what your invention ought to be, and you’ll be more prepared to submit the patent application.
How to Search for Patents
A patent search is the initial step in obtaining your patent. You can do a google patent search or do a USPTO search. Patent-pending refers to the product that has been protected by the patent application. You can search the public pair to locate the patent application. When the patent office is satisfied with your application, you will be able to do an online search for a patent number and locate the issued patent. Your product is now patent-able. Alongside the USPTO search engine, you can also utilize other search engines like espacenet, as detailed below. For assistance, consult a patent lawyer. Patents in the United States are granted by the US trademark and patent office as well as the United States patent office. The trademark office also evaluates trademark applications.
Are you interested in finding similar patents? Here are the steps you should follow:
1. Brainstorm terms that describe your invention, based on the intention, composition, and use.
Start by writing down a succinct, precise description of your invention. Avoid using generic terms such as “device”, “process,” or “system”. Instead, consider synonyms to the terms you selected initially. Then, take note of important technical terms and keywords.
To help you find the key words and concepts, try the questions below.
- What is the goal of the invention? Is it a utilitarian device or an ornamental design?
- Is inventing a method to come up with something or to perform an action? Are you referring to an item?
- What is the purpose and composition of the invention? What is the physical composition of the invention?
- What is the purpose of this invention?
- What are the terms in the technical field and keywords used to describe the nature of an invention? A technical dictionary will help you find the appropriate terms.
2. These terms will allow you to find relevant Cooperative Patent Classifications at Classification Search Tool. If you’re unable to find the right classification to describe your invention, go through the class Schemas (class schedules). Consider substituting the words you use for describing your invention, if you fail to get any results from your Classification Text Search with synonyms such as the terms you used in Step 1.
3. Go through 3. Go over the CPC Classification Definition to verify the relevancy of the CPC classification that you have found. If the chosen classification is a blue square with “D”, then the hyperlink to the CPC classification definition will be provided. CPC classification definitions will help you determine the applicable classification’s scope of application so that you can pick the one that is the one that is most appropriate. In addition the definitions may include search tips and other suggestions that may be useful to further study.
4. Find patent documents that have the CPC classification from the Patents Full-Text and Image Database. By focusing your search on abstracts and drawings that are representative it is possible to narrow your search for the most relevant patent publications.
5. This selection of patent publication is the most effective to examine for connections to your idea. Be sure to read the claims and specifications. Contact the applicant as well as the patent examiner for any additional patents.
6. You can retrieve patent applications published in the public domain that meet the CPC classification you picked in Step 3. You can also use the same method of search that you utilized in Step 4 to narrow down your search results to just the most relevant patent applications by looking over the abstracts as well as the drawings on each page. Next, carefully examine the patent applications that have been published, paying particular attention to the claims as well as additional drawings.
7. You can find additional US patent publications using keywords in the AppFT and PatFT databases, and also search for patents classified as that are not issued by the United States in the following table. You can also make use of search engines on the internet to find non-patent documents that describe inventions in the literature. For example:
- Add keywords to your search. Keyword searches may turn up documents that are not well-categorized or have missed classifications during Step 2. For example, US patent examiners often supplement their classification searches with keyword searches. Think about the use of technical engineering terminology rather than everyday words.
- Search for foreign patents using the CPC classification. Then, re-run the search using international patent office search engines such as Espacenet, the European Patent Office’s worldwide patent publication database of over 130 million patent publications. Other national databases include:
- European Patent Office (EPO) provides esp@cenet to access a network of Europe’s patent databases with access to machine translation of European patents.
- Japan Patent Office (JPO) – with access to machine translations of Japanese patents.
- World Intellectual Property Organization (WIPO) offers PATENTSCOPE with a full-text search of published international patent applications and machine translations for some documents, as well as a list of international patent databases.
- Korean Intellectual Property Rights Information Service (KIPRIS)
- State Intellectual Property Office (SIPO) with machine translation of Chinese patents.
- Other International Intellectual Property Offices with online patent databases include Australia, Canada, Denmark, Finland, France, Germany, Great Britain, India, Israel, Netherlands, Norway, Sweden, Switzerland, and Taiwan.
- Search non-patent literature. Inventions can be made public in many non-patent publications. It is recommended that you search journals, books, websites, technical catalogs, conference proceedings, and other print and electronic publications.
To review your search, you can hire a registered patent attorney to assist. A preliminary search will help one better prepare to talk about their invention and other related inventions with a professional patent attorney. In addition, the attorney will not spend too much time or money on patenting basics.