DETAILED ACTION
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Arguments
Applicant's arguments with respect to the rejections of claims 1-20 have been considered but are moot in view of new ground(s) of rejection.
Response to Amendment
Claim Rejections - 35 USC § 103
3. The text of those sections of Title 35, U.S. Code not included in this section can be found in a prior Office action.
4. Claims 1, 5-7, 11-12, and 15-17 are rejected under AIA 35 U.S.C. 103 as being obvious over Flint et al. (US Publication 2012/0198338) in view of Li et al. (English Translation of Chinese Publication CN113268782 08-2021).
Regarding claim 1, Flint discloses a method of operating an apparatus for generating a cross-edited video, the method comprising:
obtaining a plurality of videos having at least a first video and a second video (Flint, fig’s 6 and 7, para’s 0030-0038, obtain a plurality of video clips including a first video clip and a second video clip);
sequentially generating video pieces such that one of the plurality of videos is played according to a timeline, based on a first transition reward determined by calculating a similarity between the first video before a transition and the second video after the transition in a specific frame with a preset reward according to a continuous play time and based on a second transition reward determined by a time elapsed from a previous transition point (Flint, fig’s 6 and 7, para’s 0030-0038, the video clips may be dragged and dropped into video display environment 100 or continuous timeline 204. The video clips may be analyzed. For example, the content characteristics of adjoining video clips, or adjoining portions of video clips may be analyzed and/or compared to determine the color characteristics, motion characteristics, and/or temporal characteristics of the adjoining video clips or video clip portions; a transition type may be selected based on the analysis and/or comparison of adjoining video clips, or adjoining portions of video clip (i.e., a metric based on the similarity between a video frame immediately before a transition (a "pre-transition" frame) and a video frame immediately after the transition is considered a first transition reward). The transition type may be selected based on rules defined for particular content characteristics; transition types in a video clip sequence may be adjusted or changed based on the length (duration) of the video clip sequence; it is noted that the total elapsed time of the video clip sequence is based on the elapse time from each previous transition time (i.e., a second transition reward); para’s 0022-0024, fig. 4 illustrates timeline 204 that may include video clip 206, video clip 300 and transition 400 for transitioning between video clip 206 and video clip 300 for continuous play time. For example, when video clip 300 is dropped into video environment 100 or timeline 204, transition 400 may be automatically selected and placed between video clip 206 and video clip 300 in timeline 204 thereby generating a video sequence that contains video clip 206, transition 400 and video clip 300. If video clip 300 is added to timeline 204 after video clip 206, transition 400 may be selected based on an ending portion of video clip 206 and a beginning portion of video clip 300. If video clip 300 is added to timeline 204 before video clip 206, transition 400 may be selected based on an ending portion of video clip 300 and a beginning portion of video clip 206. If video clip 300 is added between two videos in the timeline, transitions may be selected for transitioning between video clip 300 and each of the videos adjacent to video clip 300 in timeline 204 based on the respective adjoining beginning and ending portions of the video clips. When the video sequence is played, transition 400 may provide a visually appealing transition between video clip 206 and video clip 300; an end portion (last sequence of frames) of video clip 206 and a beginning portion (first sequence of frames) of video clip 300 may be analyzed to determine the color characteristics and/or motion characteristics of the end portion and beginning portion, i.e., determine a comparison metric; providing a preset reward for adjusting comparison threshold is well-known in the art); and
generating a cross-edited video by connecting the video pieces (Flint, fig’s 6 and 7, para’s 0030-0038, generating a video clip sequence).
Flint does not explicitly disclose but Li discloses the first transition reward determined by combining a preset reward according to a continuous play time with the calculated similarity (Li, para’s 0040-0043, calculating the average similarity difference value of two adjacent training process, through the average similarity difference to adjust the preset similarity threshold value, until obtaining the optimal similarity threshold, comprising: based on the average value of the similarity of the user node and the adjacent node two adjacent training process of the reward function, adjusting the pre-set initial similarity threshold value for penalty/punishment, if the training process is compared with the last process, the average value of the similarity of the user node and the neighboring node is smaller; then rewarding the wheel action, otherwise, penalizing; the action space A according to the reward function of the reward trigger, adding a preset fixed value to the similarity threshold value, and according to the penalty trigger of the reward function, subtracting one of the preset fixed value from the similarity threshold value, and the preset fixed value is between 0 to 1; when the ending condition is satisfied, the similarity threshold of the day is determined as the optimal similarity threshold. See also Gui, English Translation of Chinese Publication CN111523050, para’s 0061-0062, In one example, if the value is greater than a first preset threshold, the recommendation frequency is adjusted to the recommendation frequency in the target user's recommendation direction, resulting in an adjusted recommendation frequency in the target user's recommendation direction; if the value is less than a second preset threshold, the recommendation frequency is adjusted to zero, resulting in an adjusted recommendation frequency of zero; if the value is not less than the second preset threshold and not greater than the first preset threshold, the recommendation frequency is updated, resulting in an updated recommendation frequency. Specifically, the larger the value, the more the user likes it. The first preset threshold and the second preset threshold are set according to actual needs, and this embodiment does not make specific limitations. After adding the tentative recommendation direction to the target user's recommendation direction, an interest tag for the user is formed. The adjusted recommendation frequency of this tentative recommendation direction becomes the recommendation frequency of the target user's recommendation direction. If the tentative recommendation direction is deleted, the adjusted recommendation frequency becomes zero, meaning that content corresponding to this tentative recommendation direction will no longer be recommended. Otherwise, the recommendation frequency is updated, and the adjusted recommendation frequency becomes the updated recommendation frequency. In one example, updating the recommendation frequency to obtain the adjusted recommendation frequency includes: if the value is not less than a third preset threshold and less than a first preset threshold, increasing the recommendation frequency according to a preset reward value to obtain the increased recommendation frequency; if the value is not less than a second preset threshold and less than a third preset threshold, decreasing the recommendation frequency according to a preset penalty value to obtain the decreased recommendation frequency. Specifically, the third preset threshold can be set according to actual needs, and this embodiment does not impose any specific limitations. If the value is not less than the third preset threshold and less than the first preset threshold, the preset reward value is added to the original recommendation frequency, and the sum is used as the adjusted recommendation frequency. If the value is not less than the second preset threshold and less than the third preset threshold, and the preset penalty value is positive, the difference between the original recommendation frequency and the preset penalty value is used as the adjusted recommendation frequency. If the preset penalty value is negative, the sum between the original recommendation frequency and the preset penalty value is used as the adjusted recommendation frequency.).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to incorporate Li’s features into Flint’s invention for enhancing user’s playback experience by using preset reward value in transition video editing technique for improving stability, sample efficiency, and alignment with qualitative goals.
Regarding claim 5, Flint-Li discloses the method of claim 1, wherein the second transition reward is expressed as a negative value based on the elapsed time from the previous transition point (Flint, fig’s 6 and 7, para’s 0030-0038, the video clips may be dragged and dropped into video display environment 100 or continuous timeline 204. The video clips may be analyzed. For example, the content characteristics of adjoining video clips, or adjoining portions of video clips may be analyzed and/or compared to determine the color characteristics, motion characteristics, and/or temporal characteristics of the adjoining video clips or video clip portions; a transition type may be selected based on the analysis and/or comparison of adjoining video clips, or adjoining portions of video clip (i.e., first transition reward). The transition type may be selected based on rules defined for particular content characteristics; transition types in a video clip sequence may be adjusted or changed based on the length (duration) of the video clip sequence; para. 0019, it is noted that the total elapsed time of the video clip sequence “summary video” is based on the elapse time from each previous transition time, i.e., second transition reward; expressing the second transition reward as a negative value based on the elapsed time from the previous transition point is merely design option to indicate that the total elapsed time of the video clip sequence “summary video” is based on the elapse time from each previous transition time).
Regarding claim 6, Flint-Li discloses the method of claim 1, wherein the sequentially generating of the video pieces such that one of the plurality of videos is played according to the timeline comprises: sequentially generating the video pieces based on one of the first transition reward and the second transition reward (Flint, fig’s 6 and 7, para’s 0030-0038, the video clips may be dragged and dropped into video display environment 100 or continuous timeline 204. The video clips may be analyzed. For example, the content characteristics of adjoining video clips, or adjoining portions of video clips may be analyzed and/or compared to determine the color characteristics, motion characteristics, and/or temporal characteristics of the adjoining video clips or video clip portions; a transition type may be selected based on the analysis and/or comparison of adjoining video clips, or adjoining portions of video clip (i.e., first transition reward). The transition type may be selected based on rules defined for particular content characteristics; transition types in a video clip sequence may be adjusted or changed based on the length (duration) of the video clip sequence; it is noted that the total elapsed time of the video clip sequence is based on the elapse time from each previous transition time (i.e., second transition reward).
Regarding claim 7, Flint-Li discloses the method of claim 1, wherein the sequentially generating of the video pieces comprises: when the similarity exceeds a preset threshold, selecting a corresponding video piece from among the plurality of videos based on the first transition reward (Flint, fig’s 6 and 7, para’s 0030-0038, the video clips may be dragged and dropped into video display environment 100 or continuous timeline 204. The video clips may be analyzed. For example, the content characteristics of adjoining video clips, or adjoining portions of video clips may be analyzed and/or compared to determine the color characteristics, motion characteristics, and/or temporal characteristics of the adjoining video clips or video clip portions; a transition type may be selected based on the analysis and/or comparison of adjoining video clips, or adjoining portions of video clip (i.e., a metric based on the similarity between a video frame immediately before a transition (a "pre-transition" frame) and a video frame immediately after the transition is considered a first transition reward). The transition type may be selected based on rules defined for particular content characteristics; transition types in a video clip sequence may be adjusted or changed based on the length (duration) of the video clip sequence; it is noted that the total elapsed time of the video clip sequence is based on the elapse time from each previous transition time (i.e., a second transition reward); para’s 0022-0024, fig. 4 illustrates timeline 204 that may include video clip 206, video clip 300 and transition 400 for transitioning between video clip 206 and video clip 300 for continuous play time. For example, when video clip 300 is dropped into video environment 100 or timeline 204, transition 400 may be automatically selected and placed between video clip 206 and video clip 300 in timeline 204 thereby generating a video sequence that contains video clip 206, transition 400 and video clip 300. If video clip 300 is added to timeline 204 after video clip 206, transition 400 may be selected based on an ending portion of video clip 206 and a beginning portion of video clip 300. If video clip 300 is added to timeline 204 before video clip 206, transition 400 may be selected based on an ending portion of video clip 300 and a beginning portion of video clip 206. If video clip 300 is added between two videos in the timeline, transitions may be selected for transitioning between video clip 300 and each of the videos adjacent to video clip 300 in timeline 204 based on the respective adjoining beginning and ending portions of the video clips. When the video sequence is played, transition 400 may provide a visually appealing transition between video clip 206 and video clip 300; an end portion (last sequence of frames) of video clip 206 and a beginning portion (first sequence of frames) of video clip 300 may be analyzed to determine the color characteristics and/or motion characteristics of the end portion and beginning portion, i.e., determine a comparison metric; a preset reward is an implicit or obvious default comparison threshold); and when the similarity does not exceed the threshold but exceeds a preset continuous play time, selecting a corresponding video piece from among the plurality of videos based on the second transition reward (Flint, fig’s 6 and 7, para’s 0030-0038, transition types in a video clip sequence may be adjusted or changed based on the length (duration) of the video clip sequence; it is noted that the total elapsed time of the video clip sequence is based on the elapse time from each previous transition time, i.e., second transition reward).
Claims 11-12 and 15-17 are rejected for the same reasons set forth in claims 1, and 5-7. Flint-Li further discloses processor(s), memory module(s), and computer readable medium (see Flint, para’s 0047-0048).
5. Claims 2, 9, 13 and 19 are rejected under AIA 35 U.S.C. 103 as being unpatentable over Flint-Li, as applied to claim 1 above, in view of Lemieux et al. (US Publication 2024/0267601).
Regarding claim 2, Flint-Li discloses the method of claim 1.
Flint-Li does not explicitly disclose but Lemieux discloses wherein the first transition reward is based on the similarity that is calculated based on an overlap between feature points extracted from consecutive frames before and after the specific frame (Lemieux, para. 0083, the video segments include trailing and/or leading stitching margins; the segment transition is generated by overlapping at least in part the trailing stitching margin of a first summary segment and the leading stitching margin of a second summary segment. In an example embodiment, a beat and/or timing/rhythm signature of the trailing stitching margin of the first summary segment and/or a beat and/or timing/rhythm signature of the leading stitching margin of the second summary segment are modified and/or adjusted to match one another (i.e., similarity between trailing frames of the first segment and leading frames of the second segment) and/or are synchronized in the corresponding segment transition; the segment transition is generated based on a continuous play time of the first segment and the second segment as shown on the timeline of fig. 7).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to incorporate Lemieux’s features into Flint-Li’s invention for enhancing user’s playback experience by generating a summarized video that provides smooth transition between ending portion of a first video content and beginning portion of a second video content.
Regarding claim 9, Flint-Li discloses the method of claim 1.
Flint-Li does not explicitly disclose but Lemieux discloses wherein the generating of the cross-edited video by connecting the video pieces comprises: overlapping a plurality of frames before and after the specific frame of the generated video pieces; and generating a transition effect on the overlapping frames (Lemieux, para. 0083, the segments include trailing and/or leading stitching margins and the segment transition is generated by overlapping at least in part the trailing stitching margin of a first segment and the leading stitching margin of a second segment; the timing of the cross fades (e.g., fading out of the trailing stitching margin and fading in of the leading stitching margin) is determined based on the beat and/or timing/rhythm signature of the trailing stitching margin and/or the leading stitching margin, the number of bars and/or beats present in the trailing stitching margin and/or the leading stitching margin).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to incorporate Lemieux’s features into Flint-Li’s invention for enhancing user’s playback experience by generating a summarized video that provides smooth transition between ending portion of a first video content and beginning portion of a second video content.
Claims 13 and 19 are rejected for the same reasons set forth in claims 2 and 9.
6. Claims 3 and 14 are rejected under AIA 35 U.S.C. 103 as being unpatentable over Flint-Li-Lemieux, as applied to claim 2 and 13 above, in view of Shah et al. (US Publication 2019/0073811).
Regarding claim 3, Flint-Li-Lemieux discloses the method of claim 2.
Flint-Li-Lemieux does not explicitly disclose but Shah discloses wherein the feature points are extracted from the plurality of videos in a unit of frame, and the feature points comprise at least one portion of a face region of an object comprised in a unit frame (Shah, claim 9, face in a frame is identified as feature point of the video clip; it is also noted that identifying face region, i.e., feature point, from one or more video frames is well known in the art as is evidenced by Ishikawa, US Publication 2010/0172591, para. 0295, detecting the faces of a person from the representative frames of an image segment).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to incorporate Shah’s features into Flint-Li-Lemieux’s invention for effectively identifying feature of video frames based on face depicted in each frame of the video.
Claim 14 is rejected for the same reasons set forth in claim 3.
7. Claims 8 and 18 are rejected under AIA 35 U.S.C. 103 as being unpatentable over Flint-Li, as applied to claim 1 and 12 above, in view of Newland et al. (US Publication 2023/0032838).
Regarding claim 8, Flint-Li discloses the method of claim 1.
Flint-Li does not explicitly disclose but Newland discloses wherein the obtaining of the plurality of videos comprises: extracting a feature point in a unit of frame from each of the plurality of videos (Newland, para. 0053, determining the matchability of audio features in respective frames of two signals implies extracting a feature point in a unit of frame of the signals).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to incorporate Newland’s features into Flint-Li’s invention for effectively connecting sequence of media items based on determining feature similarity of unit frame in each of the media item.
Claim 18 is rejected for the same reasons set forth in claim 8.
8. Claims 10 and 20 are rejected under AIA 35 U.S.C. 103 as being unpatentable over Flint-LI, as applied to claim 1 and 12 above, in view of Lemieux et al. (US Publication 2024/0267601), and further in view of Han (US Publication 2023/0106434).
Regarding claim 10, Flint-Li discloses the method of claim 1.
Flint-Li does not explicitly disclose:
wherein the generating of the cross-edited video by connecting the video pieces comprises: overlapping frames of the first video before the transition and the second video after the transition based on a feature point with the similarity in the specific frame;
cutting edges of the overlapping frames of the first video before the transition and the second video after the transition based on a scale of the cross-edited video.
Lemieux discloses wherein the generating of the cross-edited video by connecting the video pieces comprises: overlapping frames of the first video before the transition and the second video after the transition based on a feature point with the similarity in the specific frame (Lemieux, para. 0083, the segments include trailing and/or leading stitching margins and the segment transition is generated by overlapping at least in part the trailing stitching margin of a first segment and the leading stitching margin of a second segment; a beat and/or timing/rhythm signature of the trailing stitching margin of the first summary segment and/or a beat and/or timing/rhythm signature of the leading stitching margin of the second summary segment are modified and/or adjusted to match one another (i.e., similarity between trailing frames of the first segment and leading frames of the second segment) and/or are synchronized in the corresponding segment transition).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to incorporate Lemieux’s features into Flint-Li’s invention for enhancing user’s playback experience by generating a summarized video that provides smooth transition between ending portion of a first video content and beginning portion of a second video content.
Flint-Li-Lemieux does not explicitly disclose but Han discloses cutting edges of the overlapping frames of the first video before the transition and the second video after the transition based on a scale of the cross-edited video (Han, para. 0033, the electronic device can crop and stitch a plurality of pictures according to the user's inputs and the overlap size between every two pictures in the plurality of pictures (i.e., first cropping pictures having overlap regions, and then stitching the displayed pictures together), so as to obtain a synthesized picture. It is noted that conventional method requires the user to crop each of multiple pictures to be stitched through an electronic device to obtain pictures of sizes required for picture stitching).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to incorporate Han’s features into Flint-Li-Lemieux’s invention for generating a preferred sequence of media items by trimming off overlapped area between leading and trailing media item based on a size of the sequence of media items.
Claim 20 is rejected for the same reasons set forth in claim 10.
Conclusion
9. Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
10. Any inquiry concerning this communication or earlier communications from the examiner should be directed to LOI H TRAN whose telephone number is (571)270-5645. The examiner can normally be reached 8:00AM-5:00PM PST FIRST FRIDAY OF BIWEEK OFF.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, THAI TRAN can be reached at 571-272-7382. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/LOI H TRAN/ Primary Examiner, Art Unit 2484