Magic Leap, Inc. (Plantation, FL)

Methods and methods for synthesizing faces as images using a head-mounted device (HMD) that is as an augmented reality device, are described. The HMD might be able view only a part of the face by using an imaging system that is inward-facing, e.g., the eye’s periocular region. These methods and systems can be used to determine an image of the face for the portion of the face not imaged, based at minimum part on the face’s conformation the area. The HMD can take an image of a part of the face and apply the mapping to determine the conformity of that particular part. The HMD can blend both the observed and unobserved parts to produce a complete face image.

Modern computing and display technology have made it possible to create “virtual reality”, “augmented reality”, or “mixed realities” experiences. They are digitally reproduced images, or parts of them, that appear to be real, or are perceived as real. A typical virtual reality situation is one where it shows digital or virtual images without transparency to other visual input. A good illustration of an augmented reality scenario, also known as AR is one that displays digital or virtual information to augment the user’s perception of the surroundings. Mixed reality (MR) is a type of AR that allows physical and virtual objects be integrated and interact in real-time. Many of these issues can be addressed with VR, AR, MR environments. For ease of use, AR will be described.

FIG. FIG. 1 depicts an augmented reality scene 1000. It shows an AR user who imagines a park-like scene with trees, people buildings, and an artificial concrete platform 1120. The AR technology user perceives these things as a robot statue 1110 which is positioned on the actual-world platform 1200. A cartoon-like character 1130 is moving through the air, and is believed to be the representation of the bumblebee. The reality is that our visual system is quite complex. Therefore, it is difficult to design a VR/AR technology that allows for a natural, immersive presentation , and interaction of images with real-world or virtual image elements. The systems and methods described in this article address a variety of concerns that are related to VR (and MR) technology.

Methods and systems to synthesize an images of the face by using a head-mounted device (HMD), such as an augmented reality device are described. The HMD may only be able to see a limited portion of the face by using an inward-facing imaging device like the periocular space. The systems and methods discussed herein may result in a mapping of a conformation of the part of the face that is not imaged based at least partially on a conformation to the face portion which is imaged. The HMD can receive an image of a specific portion of the face and use the map to establish the conformity of the part of the face that is not visible. The HMD can combine the parts that are observed and those that are not to produce a complete face image.

The drawings that accompany the descriptions below provide details of some or all of the implementations of this subject matter. Other characteristics, aspects and benefits will be apparent from thedescription, the drawings, and the claims. Neither this summary nor the detailed description that follows is intended to define or limit the nature of the inventive subject matter.

Click here to view the patent on USPTO website.

Get Patents with PatentPC

What is a patent?

Granted by the government to safeguard an invention, a patent provides the inventor with exclusive rights to create, use to sell, and market the invention?society benefits when a new technology is introduced into the marketplace. The benefits may be direct terms, as it can allow people to accomplish previously unattainable things. Or indirectly, due to the opportunities for economic growth (business growth and employment) which the invention provides.

Many pharmaceutical companies and researchers at universities seek patent protection for their research and developments. Patents can be granted for products, processes, or method of creating new materials. Patent protection is granted to any invention that is valuable, novel, and not previously known to others in the same area.

Patents reward inventors for their commercially profitable inventions. They provide a motivation for inventors to create. Patents allow inventors and small businesses to know that there is an excellent chance that they will be paid back for their efforts, time and money spent on technology development. They could earn a decent income through their work.

Patents are a crucial part of firms and can be used to:

Create and protect innovative products and services;

Enhance the value, visibility, and attractiveness of your products market;

Differentiate yourself and your products from the rest.

Access to business and technical knowledge and data;

Beware of the possibility of accidentally using proprietary third-party content or losing valuable information, innovative outputs, or any other innovative output.

Patents effectively transform the inventor’s knowledge into a commercially tradeable asset that opens up new possibilities for job creation and business expansion through licensing or joint ventures.

Small businesses that have patent protection will be more attractive to investors involved in the commercialization and development of technology.

Patenting can lead to the development of fresh ideas and innovative inventions. This information could encourage innovation and may qualify for patent protection.

Patents can be used to stop untrustworthy third parties from profiting through the work of inventions.

Patent-protected technology revenue that is commercially viable can be used to finance technological research and development (R&D) that can increase the chance of better technology in future.

You can leverage the intellectual property rights of your company to convince lenders and investors that your product is a viable commercial potential. Sometimes, a single patent could lead to multiple financing opportunities. Patents can be used along with other IP assets as collateral or security financing. Investors can also see the patents you own to increase the value of your company. Forbes and others have pointed out that each patent can increase between $500,000 and one million dollars to company valuation.

Start-ups need a well-constructed business plan that is built on the IP to prove that your product/service is unique, superior, or innovative. Investors will also be impressed when you demonstrate that your IP rights are secure or is in the process of becoming secure and that they are in line with your business plan.

It is important to keep an invention under wraps until you apply to protect it with patents. Making an invention public prior to filing can frequently degrade its originality and render it unpatentable. Disclosures that are filed prior to filing, like for investors, test marketing, or other business partners must be done after signing a confidentiality contract.

There are a variety of patents. Understanding these is vital to safeguard your invention. Patents for utility are used to protect new processes and machine creations. Design patents cover ornamental designs. Utility patents are the best because they shield the owner from copycats as well as other competitors. Patents for utility are usually issued to improve or modify existing inventions. Utility patents also cover improvements and changes to existing inventions. A process patent would cover the acts or methods of performing a specific act. A chemical composition would include the combination of components.

What is the length average of a patent? Utility patents are valid for 20 years from the initial filing dates, but their expirations may be extended due to delays at the patent office, for example.

Do you want to patent your ideas? Since patents are only granted for applicants who are first to file You must make your application quickly. Contact a patent attorney at PatentPC to protect your idea today!

A patent search is an essential step when you’re writing the patent application. This will allow you to discover other ideas and give you insight into them. It will help you reduce the nature of your idea. Additionally, you’ll be able to learn about state of the technological advancements in your field of invention. You’ll get a better understanding of what your idea should be, and you’ll be better prepared for writing your patent application.

How to Search for Patents

The first step to get your patent is to do the patent search. You can do a google patent search or do a USPTO search. Patent-pending is the name used to describe the product that has been covered by the patent application. You can search for the public pair to locate the patent application. When the patent office has endorsed the patent application, you are able to conduct a patent number search to locate the issued patent and your product has been granted patent. In addition to the USPTO search engine, you may also use other search engines such as espacenet as described below. Patent lawyers or a patent attorney can assist you with the process. In the US, patents are issued by the US patent and trademark office or the United States patent and trademark office, which is also responsible for examining trademark applications.

Are you interested in finding other similar patents? Here are the steps to follow:

1. Brainstorm terms that describe your invention, based on the purpose, composition and application.

Begin by writing down a brief and precise description of your idea. Do not use generic terms such as “device”, “process” or “system”. Instead, consider synonyms to the terms you selected initially. Then, note significant technical terms, as well as keywords.

To help you find terms and keywords, you can use the questions below.

  • What is the objective of this invention? Is it a utilitarian device or an ornamental design?
  • Is the invention a method of creating something or performing some function? Is it an item?
  • What is the composition of the invention? What is the physical composition of the invention?
  • What’s the objective of this invention?
  • What are technical terms and keywords that describe the essence of an invention? A technical dictionary can help you identify the correct phrases.

2. These terms will allow you to search for pertinent Cooperative Patent Classifications on the Classification Search Tool. To find the most appropriate classification for your invention, go through the classification’s class Schemes (class schedules). If you don’t see any results using the Classification Text Search, you might want to think about substituting the words to describe your invention with synonyms.

3. Review the CPC Classification Definition to verify the relevancy of the CPC classification that you have discovered. If the classification you have selected is a blue box that has the letter “D” at its left, the link will direct you to the CPC classification’s description. CPC classification definitions can assist you in determining the classification’s range so that you can select the one that is most appropriate. They may also provide search tips or other suggestions which could prove useful in further research.

4. Find patent documents that have the CPC classification from the Patents Full-Text and Image Database. By focusing on abstracts and illustrations it is possible to narrow your search to find the most relevant patent publications.

5. This collection of patent publication is the best to check for similarity with your invention. Pay close attention to the specification and claims. Refer to the applicant and patent examiner to obtain additional patents.

6. Retrieve published patent applications with the CPC classification you picked in Step 3 of the Applications Full-Text and Image Database. You can also use the same strategy of searching you employed in Step 4 to narrow your results to the most relevant patent applications by looking over the abstracts as well as the drawings for every page. After that, take a close look at the patent applications that have been published and pay particular attention to the claims and additional drawings.

7. Locate additional US patents by keywords in the PatFT or AppFT databases, classification searching of non-U.S. patents using the below, and searching non-patent literature disclosures of inventions using web search engines. Here are a few examples:

  • Add keywords to your search. Keyword searches may turn up documents that are not well-categorized or have missed classifications during Step 2. For example, US patent examiners often supplement their classification searches with keyword searches. Think about the use of technical engineering terminology rather than everyday words.
  • Search for foreign patents using the CPC classification. Then, re-run the search using international patent office search engines such as Espacenet, the European Patent Office’s worldwide patent publication database of over 130 million patent publications. Other national databases include:
  • Search non-patent literature. Inventions can be made public in many non-patent publications. It is recommended that you search journals, books, websites, technical catalogs, conference proceedings, and other print and electronic publications.

To review your search, you can hire a registered patent attorney to assist. A preliminary search will help one better prepare to talk about their invention and other related inventions with a professional patent attorney. In addition, the attorney will not spend too much time or money on patenting basics.