DETAILED ACTION
Response to Amendment
Applicant’s amendments filed on 08 April 2026 have been entered. Claims 1, 3, 11 and 13 have been amended. Claims 2 and 12 have been previously canceled. Claims 1, 3-11, 13-21 are pending in the application., with claims 1, 12 and 21 being independent.
Continued Examination Under 37 CFR 1.114
A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 08 April 2026 has been entered.
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102 of this title, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claim(s) 1, 5, 6, 9, 10, 11, 15, 16, 19 and 20 is/are rejected under 35 U.S.C. 103 as being unpatentable over Douglas et al. (US 20200409480 A1), referred herein as Douglas in view of SCHMIDT (US 20130227493 A1), referred herein as SCHMIDT and Nishio (US 20140368420 A1), referred herein as Nishio.
Regarding Claim 1, Douglas in view of SCHMIDT and Nishio teaches a display method, comprising (Douglas Abst: An interactive 3D cursor facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image):
acquiring position information of a mouse (Douglas [0029] FIG. 1A illustrates a 3D (three-dimensional) cursor 100 overlaid on a three-dimensional medical image 102; [0036] Referring to FIG. 3, location indicators 300 and annotations 302 may be placed by the radiologist or by automated techniques to highlight locations or regions of concern within the interactive 3D cursor. The location indicators may specify a point or region within the volume of the 3D cursor);
acquiring three-dimensional object display areas of Douglas [0032] FIG. 1D illustrates filtering of selected areas or tissues of the selected image portion 112 to remove those areas or tissues from view; [0034] The dimensional measurement markings include tick marks 200, 202, and 204 that respectively designate 1 mm, 5 mm, and 1 cm increments along the edges of the cube (and thus representing three dimensions));
Douglas does not but SCHMIDT teaches
a glasses-free three-dimensional screen (SCHMIDT [0031] the command may be invoked any time the user selects an object using mouse cursor 230. For example, by clicking on the screen at a particular pixel, an object is selected by intersecting a ray drawn through that pixel with any objects in the virtual environment 200; [0020] a display device 110 that may be any conventional CRT or LED monitor).
Douglas in view of SCHMIDT further teaches
adjusting illumination information within a target area according to the three-dimensional object display areas and the position information, the target area being a preset range area centered on a position corresponding to the position information, and the illumination information including at least one of brightness information, contrast, and shadow sharpness of a three-dimensional object (Douglas [0032] FIG. 1D illustrates filtering of selected areas or tissues of the selected image portion 112 to remove those areas or tissues from view. In the illustrated example the background material 104, vein 108, and an artery 110 have been removed from view, leaving only the lobulated mass 106. The tissues to be filtered (removed from view) may be selected based on geometric shape, color, brightness, density, and any other of a variety of available image data, either alone or in combination. Moreover, a designated volume defined by a geometric shape may be removed, e.g. a geometric shape that traverses tissue boundaries.); and
displaying the three-dimensional object in the three-dimensional object display areas according to the adjusted illumination information (Douglas [0033] Transparency modification and tissue filtering facilitate presentation of certain tissue types of concern, both within the cursor and outside of the cursor. Currently, the medical professional must see through any tissue within the cursor but external to the tissue type of concern from the viewing point of the medical professional, thus degrading the visibility of the tissue of concern; [0042] Multiple interactive 3D cursors which could be of differing sizes and/or shapes could be created and displayed).
Douglas does not but Nishio teaches
wherein adjusting the illumination information includes:
adding a mouse light source acting on the target area, the mouse light source affecting the area by incorporating a set of parameters representing the mouse light source (Nishio [0079] a "light source around the light source corresponding to the semi-stationary cursor block" can be said to be a "light source corresponding to an area around the semi-stationary cursor block"); and
increasing, based on an illumination effect generated by the mouse light source, a brightness in the target area to a first brightness higher than a second brightness in a non-target area according to the three-dimensional object display areas and the position information (Nishio [0179] as the cursor is displayed, the display brightness around the cursor will change locally. For example, if the image of the cursor is a bright image, the emission brightness of the light source corresponding to the divided area including the cursor therein becomes higher than when the cursor is not included therein. Therefore, the di splay brightness around the cursor increases locally. Then, as the cursor moves, the area where the display brightness changes moves so as to follow the movement of the cursor).
SCHMIDT discloses a system and method are disclosed for manipulating objects within a virtual environment using a software widget, which is analogous to the present patent application.
It would have been obvious for a person of ordinary skill in the art before the effective filing date of the claimed invention to have modified Douglas to incorporate the teachings of SCHMIDT, and apply the CAD program that allow a user to manipulate a 3D object within a virtual environment into the interactive 3D cursor that facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image.
Doing so would enable the user to manipulate multiple degrees of freedom for manipulating the object using simple controls accessible with a single type of user input (e.g., mouse input).
Nishio discloses a technique capable of suppressing changes in display brightness due to the superimposing display of a predetermined object in such a manner that changes in display brightness due to image changes of the original image will not be suppressed. Nishio is analogous to the present patent application.
It would have been obvious for a person of ordinary skill in the art before the effective filing date of the claimed invention to have modified Douglas to incorporate the teachings of Nishio, and apply the light source corresponding to a cursor block into the interactive 3D cursor that facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image.
Doing so would enable to suppress only changes in display brightness due to the superimposing display of the cursor.
Regarding Claim 5, Douglas in view of SCHMIDTand Nishio teaches the device of claim 2, and further teaches wherein the adjusting illumination information within a target area according to the three-dimensional object display areas and the position information includes: improving a brightness of light-receiving surfaces of the three-dimensional object, a contrast of the three-dimensional object, and a shadow clarity of the backlight surfaces of the three-dimensional object in the target area according to the three-dimensional object display areas and the position information (Douglas [0046] Shadows can be added to help bring out depth perception. Proper alignment will accurately align the shadows. This enhances visual assessment for how a lesion is changing over time to include changes in tumor composition, size and morphology; [0049] Step 5 is to subtract from view additional tissue within the interactive 3D cursor as deemed appropriate by the medical professional. Step 6 is to inspect the volume within the cursor and identify region(s) of interest and place indicators, annotations, and registration markers relative to region(s) of interest).
Regarding Claim 6, Douglas in view of SCHMIDT and Nishio teaches the device of claim 1, and further teaches wherein adjusting illumination information within the target area according to the three-dimensional object display areas and the position information includes: adjusting the illumination information within the target area when a position corresponding to the position information is within the three-dimensional object display areas or between adjacent three-dimensional object display areas, the adjacent three-dimensional object display areas referring to two three-dimensional object display areas whose distance is not greater than a distance threshold (Douglas [0031] FIG. 1C illustrates modification of the transparency of the selected image portion 112. More specifically, transparency may be decreased and/or increased such that tissues and other features can be better observed, e.g. such that overlapping tissues and features are visible. For example, tissues and features located proximate to the back of the selected image portion such as lobulated mass 106 can be seen through overlapping tissues and features located proximate to the front of the selected image portion such as vein 108, when transparency is sufficiently increased).
Regarding Claim 9, Douglas in view of SCHMIDT and Nishio teaches the device of claim 1, and further teaches wherein displaying the three-dimensional object in the three-dimensional object display areas according to the adjusted illumination information includes:
adjusting pose information of the three-dimensional object according to the three-dimensional object display areas and the position information (SCHMIDT [0034] As shown in FIG. 4A, a user moves mouse cursor 230 to a second location in virtual environment 400a); and
displaying the three-dimensional object in the three-dimensional object display areas according to the adjusted illumination information and the pose information (SCHMIDT [0034] The positioning operation is completed by moving object 220 to the new location such that origin 221 corresponds to point 410 and z-axis 224 is co-axial with normal vector 412. The difference between the new orientation of object 220 and the old orientation of object 220 (with respect to the x-axis and y-axis) is minimized).
Regarding Claim 10, Douglas in view of SCHMIDT and Nishio teaches the device of claim 1, and further teaches wherein acquiring the three-dimensional object display areas includes: reading, a processor, image data currently displayed on the glasses-free three-dimensional screen, identifying an area where the three-dimensional model is located in the image data, and identifying the three-dimensional object on the glasses-free three-dimensional screen according to the area where the three-dimensional model is located and a mapping relationship between the image data and the glasses-free three-dimensional screen (Douglas [0039] Quantitative analysis can help the radiologist understand how a feature of interest such as tumor 502 (e.g., the lobulated mass 106, FIG. 1B) is changing in volume 504 over multiple time points. The interface may include a statistical representation of the tissue types, possibly including but not limited to a histogram bar chart to depict the volume (e.g., number of voxels per unit volume) of the different types of tissue within the cursor, distinct markings for different types of tissue such as, but not limited to, color coding the bars of the histogram bar chart; [0040] a respective unique false color could be selected for each different tissue type, or tissue types of particular interest or concern, and/or additional features of concern, e.g., irregular margin, indistinct margin, spiculation, etc. In the illustrated example, the background material 104 (fat) is depicted in light gray, the artery 110 is depicted in red, the vein 108 is depicted in blue, and the lobulated mass 106 is multicolored. Different colors may be selected or used to indicate stability of the lobulated mass 106 over time).
Regarding Claims 11, 15, 16, 19 and 20, Douglas in view of SCHMIDT and Nishio teaches a display device (Douglas Abst: An interactive 3D cursor facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image). The metes and bounds of the claims substantially correspond to the limitations set forth in Claims 1, 5, 6, 9 and 10; thus they are rejected on similar grounds and rationale as their corresponding limitations.
Claim(s) 3, 7, 8, 13, 17 and 18 is/are rejected under 35 U.S.C. 103 as being unpatentable over Douglas et al. (US 20200409480 A1), referred herein as Douglas in view of SCHMIDT (US 20130227493 A1), referred herein as SCHMIDT, Nishio (US 20140368420 A1), referred herein as Nishio and Dobo et al. (US 20230245636 A1), referred herein as Dobo.
Regarding Claim 3, Douglas in view of SCHMIDT and Nishio teaches the device of claim 2, but does not teach the claimed limitations herein.
However, in viewing of Dobo, the prior art teaches further comprising: gradually increasing (Nishio [0202] FIG. 4 shows an example where the pixel value of the cursor is 255. Since the pixel values other than the cursor are gradually increased through a fade effect, FIG. 4 shows the maximum pixel values of the divided areas other than the cursor block gradually increasing) the first brightness as a duration extends, the duration referring to a period during which a position corresponding to the position information remains within the three-dimensional object display areas (Dobo [0038] the indicator, which may highlight a section of an entire musical notation sequence, may represent a constant duration (representation of a time period), a dynamic duration, or an adaptive duration. A static duration indicator represents a predetermined time interval length that remains constant. A dynamic temporal length indicator represented a time interval that may be forcefully changed, for example, throughout a certain music piece (e.g., each bar), and an adaptive duration indicator may change based on or in response to changes in characteristics of audio data generated by the user and processed by the system).
Dobo discloses a method and system for indicating musical notations for at least one user, which is analogous to the present patent application.
It would have been obvious for a person of ordinary skill in the art before the effective filing date of the claimed invention to have modified Douglas to incorporate the teachings of Dobo, and apply the method of changing brightness of attention area based on duration of time period into the interactive 3D cursor that facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image.
Doing so would enable to guide a user based on the user's own attention period.
Regarding Claim 7, Douglas in view of SCHMIDT and Nishio teaches the device of claim 1. However, in view of Dobo, the prior art teaches wherein displaying the three-dimensional object in the three-dimensional object display areas according to the adjusted illumination information includes: displaying a motion animation of the three-dimensional object in the three-dimensional object display areas according to the adjusted illumination information (Dobo [0038] A dynamic temporal length indicator represented a time interval that may be forcefully changed, for example, throughout a certain music piece (e.g., each bar), and an adaptive duration indicator may change based on or in response to changes in characteristics of audio data generated by the user and processed by the system). The same motivation as claim 3 applies here.
Regarding Claim 8, Douglas in view of SCHMIDT, Nishio and Dobo teaches the device of claim 7, and further teaches wherein a motion amplitude of the three-dimensional object is determined according to a duration, which refers to a period durn which a position corresponding to the position information remain within the three-dimensional object display areas (Dobo [0039] Additionally, or alternatively, the time interval represented by the indicator may depend, for example, on the tempo of a selected musical piece displayed to the user for playing thereby. For example, a time interval indication may be longer for a musical piece that is to be played at a first, greater speed or tempo (beats per minute), than the time interval indication displayed for a musical piece to be played at a second, comparatively slower tempo. For example, a time interval indication may be shorter for a musical piece that is to be played at a first, greater speed or tempo (beats per minute), than the time interval indication displayed for a musical piece to be played at a second, comparatively slower tempo). The time interval reach on motion amplitude, and the tempo read on duration.
Regarding Claims 13, 17 and 18, Douglas in view of SCHMIDT and Nishio teaches the display device according to claim 11. The metes and bounds of the claims substantially correspond to the limitations set forth in Claims 3, 7 and 8; thus they are rejected on similar grounds and rationale as their corresponding limitations.
Claim(s) 4, 14 and 21 is/are rejected under 35 U.S.C. 103 as being unpatentable over Douglas et al. (US 20200409480 A1), referred herein as Douglas in view of SCHMIDT (US 20130227493 A1), referred herein as SCHMIDT, Nishio (US 20140368420 A1), referred herein as Nishio and Han et al. (US 11972046 B1), referred herein as Han.
Regarding Claim 4, Douglas in view of SCHMIDT and Nishio teaches the device of claim 2, but does not teach the claimed limitations herein.
However, Han teaches further comprising: increasing a range of the target area as a duration extends, the duration referring to a period during which a position corresponding to the position information is in the three-dimensional object display areas (Han col 7, ln 44-48: acquire an initial gaze area of the user when a sight line of the user continuously gazes at the current display interface for a preset duration (e.g., 1500 ms); enlarge and move the initial gaze area to a center of the screen to determine a fine gaze area of the user).
Han discloses a human-machine interaction method and system based on eye movement tracking, which is analogous to the present patent application.
It would have been obvious for a person of ordinary skill in the art before the effective filing date of the claimed invention to have modified Douglas to incorporate the teachings of Han, and apply the method for enlarging the area according to eye tracking duration into the interactive 3D cursor that facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image.
Doing so would improve efficiency and lower the error rate for the human-machine interaction method.
Regarding Claim 14, Douglas in view of SCHMIDT and Nishio teaches the display device according to claim 11. The metes and bounds of the claims substantially correspond to the limitations set forth in Claim 4; thus they are rejected on similar grounds and rationale as their corresponding limitations.
Regarding Claim 21, Douglas in view of SCHMIDT, Nishio and Han teaches a display method (Douglas Abst: An interactive 3D cursor facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image). The metes and bounds of the claims substantially correspond to the limitations set forth in Claims 1 and 4; thus they are rejected on similar grounds and rationale as their corresponding limitations.
Response to Arguments
Applicant’s arguments, see page 10, filed on 08 April 2026 with respect to 103 rejections have been considered but are moot because the new ground of rejection does not rely on any reference applied in the prior rejection of record for any teaching or matter specifically challenged in the argument.
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to Samantha (Yuehan) Wang whose telephone number is (571)270-5011. The examiner can normally be reached Monday-Friday, 8am-5pm.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, King Poon can be reached at (571)272-7440. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/Samantha (YUEHAN) WANG/
Primary Examiner
Art Unit 2617
Prosecution Insights