DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Amendment
This communication is responsive to the applicant’s amendments dated 5/6/2026. The applicant amended claims 1, 11, and 16.
Response to Arguments
Applicant's arguments with respect to 35 U.S.C. 101 (see Remarks, pg. 12, line 5 – pg. 16, line 4) filed 5/6/2026 have been fully considered but they are not persuasive.
In the final rejection mailed 2/9/2026, the applicant was advised to provide detail how the parameters are modified or how the model is specifically trained to generate the content items based upon the user attribute. The applicant has amended the limitation to include that the modification of the parameters of the content generation model is based on a loss value. This step can be done as a mental activity or a mathematical calculation. A human could calculate the loss down and see the difference. Additionally, calculating a loss function is well known, routine, and conventional. The applicant argues that the claimed invention provides a more efficient way to generating custom content, however, the examiner views the claims as performing an abstract idea using a computer. The applicant is encouraged to provide greater detail how the parameters are modified or how the model is specifically trained to generate the content items based upon the user attribute. Therefore, the 35 U.S.C. 101 rejection is maintained.
Applicant's arguments with respect to 35 U.S.C. 103 (see Remarks, pg. 16, line 5 – pg. 19, line 8) filed 5/6/2026 have been fully considered but they are not persuasive.
The applicant argues that the Xu and Wilson fails to teach, “modifying the parameters of the content generation model to generate a custom content generation model corresponding to the user account of the content management system based on a loss value associated with at least one attribute associated with the one or more content items, wherein the at least one attribute comprises a visual characteristic of the one or more content items associated with the user account" and "in response to the request to generate the new content item, generating a custom content item utilizing the custom content generation model having the modified parameters to synthesize the at least one attribute associated with the one or more content items associated with the user account within the custom content item”. In particular, the applicant argues that Xu and Wilson fail to teach “a custom content generation model corresponding to the user account of the content management system”. Given the amendments, the examiner has provided a new ground of rejection below.
Claim Rejections - 35 USC § 101
35 U.S.C. 101 reads as follows:
Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title.
Claims 1-20 are rejected under 35 U.S.C. 101 because the claimed invention is directed to and abstract idea without significantly more.
Independent claim 1 recites, “identifying, for a user account of a content management system, one or more content items for fine-tuning parameters of a content generation model trained utilizing training content items to generate new content items, wherein the training content items are different from the one or more content items”, “modifying the parameters of the content generation model to generate a custom content generation model corresponding to the user account of the content management system based on a loss value associated with at least one attribute associated with the one or more content items, wherein the at least one attribute comprises a visual characteristic of the one or more content items associated with the user account”, “receiving, from a client device associated with the user account, a request to generate a new content item”, and “in response to the request to generate the new content item, generating a custom content item utilizing the custom content generation model having the modified parameters to synthesize the at least one attribute associated with the one or more content items associated with the user account within the custom content item.”
The limitation of identifying content for adjustment, as drafted, is a process, under its broadest reasonable interpretation, covers performance of the limitation in the mind. Nothing in the claim precludes the step from practically being performed in the mind. For example, “identifying” in the context of this claim encompasses selecting text, which a human can do both in the mind or with a pen and paper. Next, the limitation of modifying parameters of a model, under its broadest reasonable interpretation, covers performance of the limitation in the mind. Nothing in the claim precludes the step from practically being performed in the mind. For example, “modifying” in the context of this claim encompasses adjusting rules, which a human can do both in the mind or with a pen and paper. Next, the limitation of receiving a request, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components. That is, other than reciting “a client device”, nothing in the claim precludes the step from practically being performed in the mind. For example, “receiving” in the context of this claim encompasses receiving a command, which a human can do both in the mind or with a pen and paper. Lastly, the limitation of generating a custom content item, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components. That is, other than reciting “model”, nothing in the claim precludes the step from practically being performed in the mind. For example, “generating” in the context of this claim could encompass editing text, which a human can do both in the mind or with a pen and paper.
The judicial exception is not integrated into a practical application. In particular, the claim only recites the additional elements, using a “a client device” and a “model”, to modify content. These elements in these steps are recited at a high-level of generality such that is amounts no more than mere instructions to apply the exception using generic computer component. Accordingly, this additional element does not integrate the abstract idea into a practical application because it does not impose any meaningful limits on practicing the abstract idea. The claim is directed to an abstract idea.
The claim does not include additional elements that are sufficient to amount to significantly more than the judicial exception. As discussed above with respect to the integration of the abstract idea into a practical application, the additional elements of using a client device and a model to perform content modification amounts to no more than mere instructions to apply the exception using generic computer components. Mere instructions to apply an exception using generic computer components cannot provide an inventive concept. The claim is not patent eligible.
Dependent claims 2-10 are also rejected for the same reasons provided in independent claim 1 above. The dependent claim, including the further recited limitation, does not integrate the abstract idea into a practical application and the additional elements, taken individually and in combination do not contribute to an inventive concept. In other words, the dependent claim is directed to an abstract idea without significantly more.
Independent claim 11 recites, “identify, for a user account of a content management system, one or more content items associated with the user account”, “receive, from a client device associated with the user account, a request to generate a new content item based on a content description corresponding to the request”, and “in response to the request to generate the new content item, generate a custom content item by utilizing a custom content generation model corresponding to the user account of the content management system trained utilizing training content items different from the one or more content items to synthesize content that depicts the content description from the request with at least one attribute from the one or more content items associated with the user account within the custom content item in accordance with parameters of the custom content generation model that are based on a loss value associated with the at least one attribute, wherein the at least one attribute comprises a visual characteristic of the one or more content items associated with the user account”.
The limitation of identifying content for adjustment, as drafted, is a process, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components. That is, other than reciting “non-transitory computer-readable medium” and “a processor”, nothing in the claim precludes the step from practically being performed in the mind. For example, “identify” in the context of this claim encompasses selecting text, which a human can do both in the mind or with a pen and paper. Next, the limitation of receiving a request, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components. That is, other than reciting “a client device”, nothing in the claim precludes the step from practically being performed in the mind. For example, “receive” in the context of this claim encompasses receiving a command, which a human can do both in the mind or with a pen and paper. Lastly, the limitation of generating a custom content item, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components. That is, other than reciting “model”, nothing in the claim precludes the step from practically being performed in the mind. For example, “generate” in the context of this claim could encompass editing text, which a human can do both in the mind or with a pen and paper.
The judicial exception is not integrated into a practical application. In particular, the claim only recites the additional elements, using a “a client device”, “model”, “non-transitory computer-readable medium” and “processor” to modify content. These elements in these steps are recited at a high-level of generality such that is amounts no more than mere instructions to apply the exception using generic computer component. Accordingly, this additional element does not integrate the abstract idea into a practical application because it does not impose any meaningful limits on practicing the abstract idea. The claim is directed to an abstract idea.
The claim does not include additional elements that are sufficient to amount to significantly more than the judicial exception. As discussed above with respect to the integration of the abstract idea into a practical application, the additional elements of using a client device, a model, a non-transitory computer-readable medium, and processor to perform content modification amounts to no more than mere instructions to apply the exception using generic computer components. Mere instructions to apply an exception using generic computer components cannot provide an inventive concept. The claim is not patent eligible.
Dependent claims 12-15 are also rejected for the same reasons provided in independent claim 11 above. The dependent claim, including the further recited limitation, does not integrate the abstract idea into a practical application and the additional elements, taken individually and in combination do not contribute to an inventive concept. In other words, the dependent claim is directed to an abstract idea without significantly more.
Independent claim 16 recites, “identify, for a user account of a content management system, a set of content items for fine-tuning parameters of a content generation model trained utilizing training content items to generate new content items, wherein the training content items are different from the set of content items”, “modify the parameters of the content generation model to generate a custom content generation model corresponding to the user account of the content management system based on a loss value associated with at least one attribute associated with the set of content items, wherein the at least one attribute comprises a visual characteristic of the set of content items associated with the user account” “receive, from a client device associated with the user account, a request to generate a new content item based on a user selection of a subset of content items from the set of content items”, and “in response to the request to generate the new content item and the user selection of the subset of content items, generate a custom content item utilizing the custom content generation model having the modified parameters to synthesize at least one attribute associated with the subset of content items associated with the user account within the custom content item”.
The limitation of identifying a set of content for adjustment, as drafted, is a process, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components. That is, other than reciting, “non-transitory computer-readable medium” and “processor”, nothing in the claim precludes the step from practically being performed in the mind. For example, “identify” in the context of this claim encompasses selecting a set of text, which a human can do both in the mind or with a pen and paper. Next, the limitation of modifying parameters of a model, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components. That is, other than reciting, “non-transitory computer-readable medium” and “processor”, nothing in the claim precludes the step from practically being performed in the mind. For example, “modify” in the context of this claim encompasses adjusting rules, which a human can do both in the mind or with a pen and paper. Next, the limitation of receiving a request, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components. That is, other than reciting “a client device”, nothing in the claim precludes the step from practically being performed in the mind. For example, “receive” in the context of this claim encompasses receiving a command, which a human can do both in the mind or with a pen and paper. Lastly, the limitation of generating a custom content item, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components. That is, other than reciting “model”, “non-transitory computer-readable medium” and “processor”, nothing in the claim precludes the step from practically being performed in the mind. For example, “generate” in the context of this claim could encompass editing text, which a human can do both in the mind or with a pen and paper.
The judicial exception is not integrated into a practical application. In particular, the claim only recites the additional elements, using “a client device”, a “model”, “non-transitory computer-readable medium” and “processor” to modify content. These elements in these steps are recited at a high-level of generality such that is amounts no more than mere instructions to apply the exception using generic computer component. Accordingly, this additional element does not integrate the abstract idea into a practical application because it does not impose any meaningful limits on practicing the abstract idea. The claim is directed to an abstract idea.
The claim does not include additional elements that are sufficient to amount to significantly more than the judicial exception. As discussed above with respect to the integration of the abstract idea into a practical application, the additional elements of using a client device, a model, a non-transitory computer-readable medium, and processor to perform content modification amounts to no more than mere instructions to apply the exception using generic computer components. Mere instructions to apply an exception using generic computer components cannot provide an inventive concept. The claim is not patent eligible.
Dependent claims 17-20 are also rejected for the same reasons provided in independent claim 16 above. The dependent claim, including the further recited limitation, does not integrate the abstract idea into a practical application and the additional elements, taken individually and in combination do not contribute to an inventive concept. In other words, the dependent claim is directed to an abstract idea without significantly more.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1-3, 5, 9-13, and 16-17 are rejected under 35 U.S.C. 103 as being unpatentable over Xu et al. US 20230042221 A1 (hereinafter Xu) in view of Green (US 9558428 B1) in view of Wilson et al. US 20220377257 A1 (hereinafter Wilson)
Regarding claim 1, Xu teaches a computer-implemented method comprising:
identifying, for a user account of a content management system, one or more content items for fine-tuning parameters of a content generation model trained to generate new content items; (FIG. 2A, 202, 208 [0042] “the language-guided image-editing system 106 receives an image 202 displayed within a client device 204”, examiner interprets 202 as an example of a content item; [0046] “the language-guided image-editing system 106 utilizes the cycle augmented generative adversarial neural network 208 to generate a modified image that reflects the modification request from the natural language text 206 within the image 202”, examiner interprets 208 to be the content generation model; FIG. 1, 112, 106, [0035] “the client device 110 is operated by a user to perform a variety of functions (e.g., via a digital graphics application 112)”, examiner interprets the user account to be linked to the graphics application and 106 to be the content management system);
receiving, from a client device associated with the user account, a request to generate a new content item (FIG. 2A, 206 (request), 210 (new content), 204 (client device));
Xu fails to teach a content generation model trained utilizing training content items to generate new content items, wherein the training content items are different from the one or more content items; modifying the parameters of the content generation model to generate a custom content generation model corresponding to the user account of the content management system based on a loss value associated with at least one attribute associated with the one or more content items, wherein the at least one attribute comprises a visual characteristic of the one or more content items associated with the user account; and in response to the request to generate the new content item, generating a custom content item utilizing the custom content generation model having the modified parameters to synthesize the at least one attribute associated with the one or more content items associated with the user account within the custom content item.
However, Green teaches a content generation model trained utilizing training content items to generate new content items, wherein the training content items are different from the one or more content items ([Column 9, line 46-49] “the processing module 230, 240, 250 utilizes the analytical model created during initial training to predict what particular edits to various attributes of an image would be desired by the user”);
modifying the parameters of the content generation model to generate a custom content generation model corresponding to the user account of the content management system ([Column 9, line 12-16] “the input receiving component 205 routes information instead to a central location for analytical model building and training. After the model is built and trained with a user's individual image editing style, that model can then be copied to a processing module”); wherein the at least one attribute comprises a visual characteristic of the one or more content items associated with the user account ([Column 5, line 15-19] “all adjustments to attributes of the image by the user, e.g., temperature, tint, exposure, highlights, whites, blacks, shadows, contrast, saturation, vibrance, and hue (red, orange, yellow, etc.)”);
in response to the request to generate the new content item, generating a custom content item utilizing the custom content generation model having the modified parameters to synthesize the at least one attribute associated with the one or more content items associated with the user account within the custom content item (FIG. 1, 150, [Column 6, line 53-56] “These programs enable a user to view the images with attribute edits already applied 150 by the automatic image editing system 110, however the user need not be forced to visually review the edited images.”).
Xu in view of Green is considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques performing language guided digital image editing utilizing a cycle-augmentation generative-adversarial neural network (CAGAN) that is augmented using a cross-modal cyclic mechanism of Xu with the technique of modifying a model based on a user’s preference taught by Green in order to improve techniques of computer-based automatic editing of photographic images (see Green [Column 1, line 6-8]).
Green fails to teach modifying parameters based on a loss value associated with at least one attribute associated with the one or more content items
However, Wilson teaches modifying parameters based on a loss value associated with at least one attribute associated with the one or more content items ([0082] “a model is deployed after training, the personal style generator 405 generates actual source images (e.g., images indicated in a video feed of a meeting application) and because it has been trained with the correct loss, it outputs images with data representing the user's personal style in a manner that looks realistic”)
Xu in view of Green in view of Wilson is considered to be analogous to the claimed invention because all are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of digital content transformation of Xu in view of Green with the technique of modifying parameters based on a loss value taught by Wilson in order to improve techniques of applying data indicative of a personal style to a feature of a user represented in one or more images based on determining or estimating the personal style (see Wilson [Abstract]).
Regarding claim 2, Xu in view of Green in view of Wilson teaches all of the limitations of claim 1, upon which claim 2 depends.
Additionally, Xu teaches wherein receiving the request to generate the new content item comprises receiving a text prompt describing content to depict within the new content item (FIG. 3 [0018] “the language-guided image-editing system utilizes the cyclically trained GAN to modify an image based on a natural language modification request for the image (e.g., text-based request”).
Regarding claim 3, Xu in view of Green in view of Wilson teaches all of the limitations of claim 2, upon which claim 3 depends.
Additionally, Xu teaches wherein generating the custom content item comprises utilizing the content generation model to synthesize one or more features represented in the content of the text prompt (FIG. 2A, examiner interprets 206 to potentially be a text prompt at shown in [0018]).
Regarding claim 5, Xu in view of Green in view of Wilson teaches all of the limitations of claim 1, upon which claim 5 depends.
Additionally, Xu teaches receiving, from the client device associated with the user account, a selection of user-selected content items from the one or more content items; and in response to the request to generate the new content item, generating the custom content item utilizing the content generation model to synthesize the at least one attribute associated with the user-selected content items within the custom content item (FIG. 2A, image 202 is being requested for modification, therefore it is reasonable to assume it was selected by the user from one or more content items).
Regarding claim 9, Xu in view of Green in view of Wilson teaches all of the limitations of claim 1, upon which claim 9 depends.
Additionally, Xu teaches wherein the custom content item comprises an image, a video, or a text document (FIG. 2A, 202).
Regarding claim 10, Xu in view of Green in view of Wilson teaches all of the limitations of claim 1, upon which claim 10 depends.
Additionally, Wilson teaches modifying the parameters of the content generation model to generate a custom content generation model that synthesizes the visual characteristic of the one or more content items associated with the user account ([0023] “embodiments can receive a first image (e.g., a screenshot) or set of images (e.g., a video feed) of a first user that indicates the personal style of the first user, such as a hair style or makeup style of the first user. The first image can then be fed to one or more machine learning models in order to learn and capture the personal style of the first user. For example, particular models (e.g., a modified Generative Adversarial Network (GAN)) can perform several training epochs to learn that the first user always wears blue eyeshadow with blue lipstick at a particular pattern”; [0028])
Regarding claim 11, Xu teaches a non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause a computing device to:
identify, for a user account of a content management system, one or more content items associated with the user account (FIG. 2A, 202, 208 [0042] “the language-guided image-editing system 106 receives an image 202 displayed within a client device 204”, examiner interprets 202 as an example of a content item; [0046] “the language-guided image-editing system 106 utilizes the cycle augmented generative adversarial neural network 208 to generate a modified image that reflects the modification request from the natural language text 206 within the image 202”, examiner interprets 208 to be the content generation model; FIG. 1, 112, 106, [0035] “the client device 110 is operated by a user to perform a variety of functions (e.g., via a digital graphics application 112)”, examiner interprets the user account to be linked to the graphics application and 106 to be the content management system.);
receive, from a client device associated with the user account, a request to generate a new content item based on a content description corresponding to the request (FIG. 2A, 206 (request), 210 (new content), 204 (client device); FIG. 2A, 206, [0045] “a visual modification request includes a natural language text instruction or command that specifies one or more editing operations (e.g., brightness, hue, tone, saturation, contrast, exposure, removal), one or more adjustment types (e.g., increase, decrease, change, set), and/or one or more degrees of adjustments (e.g., a lot, a little, a numerical value)”, examiner interprets text instruction/command as content description);
Xu fails to teach in response to the request to generate the new content item, generate a custom content item by utilizing a custom content generation model corresponding to the user account of the content management system trained utilizing training content items different from the one or more content items to synthesize content that depicts the content description from the request with at least one attribute from the one or more content items associated with the user account within the custom content item in accordance with parameters of the custom content generation model that are based on a loss value associated with the at least one attribute, wherein the at least one attribute comprises a visual characteristic of the one or more content items associated with the user account.
However Green teaches in response to the request to generate the new content item, generate a custom content item by utilizing a custom content generation model corresponding to the user account of the content management system trained utilizing training content items different from the one or more content items to synthesize content that depicts the content description from the request with at least one attribute from the one or more content items associated with the user account within the custom content item, wherein the at least one attribute comprises a visual characteristic of the one or more content items associated with the user account (FIG. 1, 150, [Column 6, line 53-56] “These programs enable a user to view the images with attribute edits already applied 150 by the automatic image editing system 110, however the user need not be forced to visually review the edited images”; [Column 5, line 15-19] “all adjustments to attributes of the image by the user, e.g., temperature, tint, exposure, highlights, whites, blacks, shadows, contrast, saturation, vibrance, and hue (red, orange, yellow, etc.)”);.
Xu in view of Green is considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques performing language guided digital image editing utilizing a cycle-augmentation generative-adversarial neural network (CAGAN) that is augmented using a cross-modal cyclic mechanism of Xu with the technique of modifying a model based on a user’s preference taught by Green in order to improve techniques of computer-based automatic editing of photographic images (see Green [Column 1, line 6-8]).
Green fails to teach in accordance with parameters of the custom content generation model that are based on a loss value associated with the at least one attribute
However, Wilson teaches in accordance with parameters of the custom content generation model that are based on a loss value associated with the at least one attribute ([0082] “a model is deployed after training, the personal style generator 405 generates actual source images (e.g., images indicated in a video feed of a meeting application) and because it has been trained with the correct loss, it outputs images with data representing the user's personal style in a manner that looks realistic”)
Xu in view of Green in view of Wilson is considered to be analogous to the claimed invention because all are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of digital content transformation of Xu in view of Green with the technique of modifying parameters based on a loss value taught by Wilson in order to improve techniques of applying data indicative of a personal style to a feature of a user represented in one or more images based on determining or estimating the personal style (see Wilson [Abstract]).
Regarding claim 12, Xu in view of Green in view of Wilson teaches all of the limitations of claim 11, upon which claim 12 depends.
Additionally, Xu teaches a text prompt comprising one or more features to depict within the new content item as the content description; or one or more user-selected menu options comprising the one or more features to depict within the new content item as the content description (FIG. 2A, 206, [0045] “a visual modification request includes a natural language text instruction or command that specifies one or more editing operations (e.g., brightness, hue, tone, saturation, contrast, exposure, removal), one or more adjustment types (e.g., increase, decrease, change, set), and/or one or more degrees of adjustments (e.g., a lot, a little, a numerical value)”, examiner interprets text instruction/command as content description).
Regarding claim 13, Xu in view of Green in view of Wilson teaches all of the limitations of claim 12, upon which claim 13 depends.
Additionally, Xu teaches further comprising instructions that, when executed by the at least one processor, cause the computing device to: identify one or more feature weights associated with the one or more features of the content description (FIG. 6, 602, [0087] “the language-guided image-editing system 106 utilizes a natural language text t (e.g., “brighten the image and remove the woman on the left”) with a language encoder 602 to generate a natural language embedding h…106 generates a visual feature map V from an image x utilizing an image encoder 606”; [0088] “the modified visual feature map V′ is generated through the scaling and shifting of the visual feature map V using a reweighted natural language embedding that indicates degrees of editing within different locations of an image”); and
generate the custom content item by utilizing the content generation model to synthesize the content that depicts the content description from the request based on the one or more feature weights ([0089] “the language-guided image-editing system 106 utilizes a cycle augmented generative adversarial neural network 610 (as described above) to generate a modified image {tilde over (x)} based on the modified visual feature map V”).
Regarding claim 16, Xu teaches a system comprising:
at least one processor (FIG. 13, 1302); and
at least one non-transitory computer-readable storage medium storing instructions that, when executed by the at least one processor (FIG. 13, 1306), cause the system to:
identify, for a user account of a content management system, a set of content items for fine-tuning parameters of a content generation model trained to generate new content items, (FIG. 2A, 202, 208 [0042] “the language-guided image-editing system 106 receives an image 202 displayed within a client device 204”, examiner interprets 202 as an example of a content item; [0046] “the language-guided image-editing system 106 utilizes the cycle augmented generative adversarial neural network 208 to generate a modified image that reflects the modification request from the natural language text 206 within the image 202”, examiner interprets 208 to be the content generation model; FIG. 1, 112, 106, [0035] “the client device 110 is operated by a user to perform a variety of functions (e.g., via a digital graphics application 112)”, examiner interprets the user account to be linked to the graphics application and 106 to be the content management system; [0035] “the client device 110 performs functions such as, but not limited to, capturing and storing images (or videos), displaying images (or other content), and modifying (or editing) the images (or videos).”, examiner interprets more than one media content as set.);
receive, from a client device associated with the user account, a request to generate a new content item based on a user selection of a subset of content items from the set of content items (FIG. 2A, 206 (request), 210 (new content), 204 (client device); examiner interprets the selection of more than one media content from a larger group as a subset);
Xu fails to teach a content generation model trained utilizing training content items to generate new content items, wherein the training content items are different from the one or more content items; modify the parameters of the content generation model to generate a custom content generation model corresponding to the user account of the content management system based on a loss value associated with at least one attribute associated with the set of content items, wherein the at least one attribute comprises a visual characteristic of the set of content items associated with the user account; in response to the request to generate the new content item and the user selection of the subset of content items, generate a custom content item utilizing the custom content generation model having the modified parameters to synthesize at least one attribute associated with the subset of content items associated with the user account within the custom content item.
However, Green teaches a content generation model trained utilizing training content items to generate new content items, wherein the training content items are different from the one or more content items ([Column 9, line 46-49] “the processing module 230, 240, 250 utilizes the analytical model created during initial training to predict what particular edits to various attributes of an image would be desired by the user”);
modify the parameters of the content generation model to generate a custom content generation model corresponding to the user account of the content management system ([Column 9, line 12-16] “the input receiving component 205 routes information instead to a central location for analytical model building and training. After the model is built and trained with a user's individual image editing style, that model can then be copied to a processing module”), wherein the at least one attribute comprises a visual characteristic of the set of content items associated with the user account ([Column 5, line 15-19] “all adjustments to attributes of the image by the user, e.g., temperature, tint, exposure, highlights, whites, blacks, shadows, contrast, saturation, vibrance, and hue (red, orange, yellow, etc.)”);
in response to the request to generate the new content item and the user selection of the subset of content items, generate a custom content item utilizing the custom content generation model having the modified parameters to synthesize at least one attribute associated with the subset of content items associated with the user account within the custom content item (FIG. 1, 150, [Column 6, line 53-56] “These programs enable a user to view the images with attribute edits already applied 150 by the automatic image editing system 110, however the user need not be forced to visually review the edited images”).
Xu in view of Green is considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques performing language guided digital image editing utilizing a cycle-augmentation generative-adversarial neural network (CAGAN) that is augmented using a cross-modal cyclic mechanism of Xu with the technique of modifying a model based on a user’s preference taught by Green in order to improve techniques of computer-based automatic editing of photographic images (see Green [Column 1, line 6-8]).
Green fails to teach modifying parameters based on a loss value associated with at least one attribute associated with the set of content items
However, Wilson teaches modifying parameters based on a loss value associated with at least one attribute associated with the set of content items ([0082] “a model is deployed after training, the personal style generator 405 generates actual source images (e.g., images indicated in a video feed of a meeting application) and because it has been trained with the correct loss, it outputs images with data representing the user's personal style in a manner that looks realistic”)
Xu in view of Green in view of Wilson is considered to be analogous to the claimed invention because all are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of digital content transformation of Xu in view of Green with the technique of modifying parameters based on a loss value taught by Wilson in order to improve techniques of applying data indicative of a personal style to a feature of a user represented in one or more images based on determining or estimating the personal style (see Wilson [Abstract]).
Regarding claim 17, Xu in view of Green in view of Wilson teaches all of the limitations of claim 16, upon which claim 17 depends.
Additionally, Xu teaches wherein receiving the request to generate the new content item comprises receiving a text prompt describing content to depict within the new content item and further comprising instructions that, when executed by the at least one processor, cause the system to generate the custom content item utilizing the content generation model to synthesize one or more features represented in the content of the text prompt (FIG. 3 [0018] “the language-guided image-editing system utilizes the cyclically trained GAN to modify an image based on a natural language modification request for the image (e.g., text-based request”; FIG. 2B, examiner interprets 214 to potentially be a text prompt at shown in [0018]).
Claims 4 and 19 are rejected under 35 U.S.C. 103 as being unpatentable over Xu in view of Green in view of Wilson, as showin in claim 1 above, in further view of Nichoson et al. US 10860196 B1 (hereinafter Nichoson).
Regarding claim 4, Xu in view of Green in view of Wilson teaches all of the limitations of claim 1, upon which claim 4 depends.
Xu in view of Green in view of Wilson fails to teach further comprising providing, for display within a graphical user interface of the client device, the custom content item and one or more selectable options to share the custom content item, store the custom content item, or modify the custom content item.
However, Nichoson teaches further comprising providing, for display within a graphical user interface of the client device, the custom content item and one or more selectable options to share the custom content item, store the custom content item, or modify the custom content item (FIG. 10, 1004, 1006, 302)
Xu in view of Green in view of Wilson in view of Nichoson are considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of editing digital content of Xu in view of Green in view of Wilson with the technique of providing various selectable options taught by Nichoson in order to improve techniques for edit experience for transformation of digital content are delivered in a digital medium environment (see Nichoson [Column 1, line 54-56]).
Regarding claim 19, Xu in view of Green in view of Wilson teaches all of the limitations of claim 16, upon which claim 19 depends.
Xu in view of Green in view of Wilson fails to teach further comprising instructions that, when executed by the at least one processor, cause the system to: receive, from the client device associated with the user account, user feedback for the custom content item; and modify the parameters of the content generation model based on the set of content items utilizing the user feedback to generate an updated content generation model.
However, Nichoson teaches further comprising instructions that, when executed by the at least one processor, cause the system to: receive, from the client device associated with the user account, user feedback for the custom content item (FIG. 17, 1702, [Column 15, line 50-57] “selecting the feedback control 1702 causes a feedback experience (e.g., a digital feedback form) to be presented that enables the user to input feedback about the remixed image 1506. Generally, the feedback may indicate a user impression of the remixed image 1506, such as positive or negative feedback. The feedback may then be published, such as to the image editing service 104 and/or to the user that generated the remixed image 1506”);
and modify the parameters of the content generation model based on the set of content items utilizing the user feedback to generate an updated content generation model ([Column 17, line 13- Column 17, line 19] “if multiple similar visual images are identified, a particular similar image may be selected for use based on a particular criteria, such as feedback received regarding the particular similar image. For instance, if the particular similar image is determined to have more positive feedback than the other identified similar images (e.g., more “likes”), the particular similar image is selected”).
Xu in view of Green in view of Wilson in view of Nichoson are considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of editing digital content of Xu in view of Green in view of Wilson with the technique of providing various selectable options taught by Nichoson in order to improve techniques for edit experience for transformation of digital content are delivered in a digital medium environment (see Nichoson [Column 1, line 54-56]).
Claims 6-8, 14-15, and 18 are rejected under 35 U.S.C. 103 as being unpatentable over Xu in view of Green in view of Wilson in view of Brandt et al. US 20240169624 A1 (hereinafter Brandt).
Regarding claim 6, Xu in view of Green in view of Wilson teaches all of the limitations of claim 1, upon which claim 6 depends.
Xu in view of Green in view of Wilson fails to teach identifying, from an additional user account of the content management system, one or more additional content items for fine-tuning the parameters of the content generation model trained to generate the new content items; modifying the parameters of the content generation model based on the at least one attribute associated with the one or more content items and at least one additional attribute associated with the one or more additional content items; and generating the custom content item utilizing the content generation model to synthesize the at least one attribute associated with the one or more content items and the at least one additional attribute associated with the one or more additional content items within the custom content item.
However, Brandt teaches identifying, from an additional user account of the content management system, one or more additional content items for fine-tuning the parameters of the content generation model trained to generate the new content items ([0078] FIG. 1, “the image editing system 104 provides functionality by which a client device (e.g., a user of one of the client devices 110a-110n) generates, edits, manages, and/or stores digital images”, examiner interprets the additional client devices to be linked to additional users);
modifying the parameters of the content generation model based on the at least one attribute associated with the one or more content items and at least one additional attribute associated with the one or more additional content items (FIG. 3, [0038] “the language-guided image-editing system 106 on the server device(s) 102 learns parameters for one or more neural networks…the client device 110 obtains (e.g., downloads) the language-guided image-editing system 106 with one or more neural network with the learned parameters from the server device. modified digital images in accordance with natural language requests independent from the server device(s) 102” [0054] “[0054] For example, FIG. 3 illustrates the language-guided image-editing system 106 learning parameters of an editing description neural network”); and
generating the custom content item utilizing the content generation model to synthesize the at least one attribute associated with the one or more content items and the at least one additional attribute associated with the one or more additional content items within the custom content item (FIG. 22-24, FIG. 30, [0370] “the scene-based image editing system 106 modifies the visual indication 2218 of the selection to indicate that the object 2208b has been added to the selection”, examiner interprets adding objects (with their own unique attributes) to a potentially modified image as generating custom content with different attributes.)
Xu in view of Green in view of Wilson in view of Brandt are considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of modifying digital content of Xu in view of Green in view of Wilson with the technique of generating custom content from additional users taught by Brandt in order to improve techniques for modifying digital images via scene-based editing using image understanding facilitated by artificial intelligence (see Brandt [Abstract]).
Regarding claim 7, Xu in view of Green in view of Wilson in view of Brandt teaches all of the limitations of claim 6, upon which claim 7 depends.
Additionally, Brandt teaches further comprising providing access to the custom content item to the user account and the additional user account (FIG. 1, [0078-0079] “a client device sends a digital image to the image editing system 104 hosted on the server(s) 102 via the network 108. The image editing system 104 then provides options that the client device may use to edit the digital image, store the digital image, and subsequently search for, access, and view the digital image.”)
Regarding claim 8, Xu in view of Green in view of Wilson teaches all of the limitations of claim 1, upon which claim 8 depends.
Xu in view of Green in view of Wilson fails to teach receiving, from the client device associated with the user account, an attribute weight for the at least one attribute; and generating the custom content item by utilizing the content generation model to synthesize the at least one attribute associated with the one or more content items within the custom content item based on the attribute weight.
However, Brandt teaches receiving, from the client device associated with the user account, an attribute weight for the at least one attribute (FIG. 21B-21C, [0299] “a real-world class description graph provides object attributes assigned to a given object, such as shape, color, material from which the object is made, weight of the object, weight the object can support, and/or various other attributes determined to be useful in subsequently modifying a digital image”); and
generating the custom content item by utilizing the content generation model to synthesize the at least one attribute associated with the one or more content items within the custom content item based on the attribute weight ([0355] “the scene-based image editing system 106 detects a user interaction with the slider element 2116 of the slider bar 2114, increasing the degree to which the corresponding object attribute appears in the digital image”)
Xu in view of Green in view of Wilson in view of Brandt are considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of modifying digital content of Xu in view of Green in view of Wilson with the technique of generating custom content from additional users taught by Brandt in order to improve techniques for modifying digital images via scene-based editing using image understanding facilitated by artificial intelligence (see Brandt [Abstract]).
Regarding claim 14, Xu in view of Green in view of Wilson teaches all of the limitations of claim 11, upon which claim 14 depends.
Xu in view of Wilson fails to teach further comprising instructions that, when executed by the at least one processor, cause the computing device to: receive, from the client device associated with the user account, a selection of user-selected content items from the one or more content items; and generate the custom content item utilizing the content generation model to synthesize the at least one attribute associated with the user-selected content items within the custom content item.
However, Brandt teaches further comprising instructions that, when executed by the at least one processor, cause the computing device to: receive, from the client device associated with the user account, a selection of user-selected content items from the one or more content items (FIG. 25, [0395] “the scene-based image editing system 106 detects a user interaction selecting the object 2508e”); and
generate the custom content item utilizing the content generation model to synthesize the at least one attribute associated with the user-selected content items within the custom content item (FIG. 22-24, FIG. 30, [0370] “the scene-based image editing system 106 modifies the visual indication 2218 of the selection to indicate that the object 2208b has been added to the selection”, examiner interprets the selected items can be added to a modified image)
Xu in view of Green in view of Wilson in view of Brandt are considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of modifying digital content of Xu in view of Green in view of Wilson with the technique of generating custom content from additional users taught by Brandt in order to improve techniques for modifying digital images via scene-based editing using image understanding facilitated by artificial intelligence (see Brandt [Abstract]).
Regarding claim 15, Xu in view of Green in view of Wilson teaches all of the limitations of claim 11, upon which claim 15 depends.
Additionally, Xu teaches generate the custom content item utilizing the content generation model to synthesize the content that depicts the content description from the request with the at least one attribute associated with the one or more content items and the at least one additional attribute associated with the one or more additional content items within the custom content item (FIG. 2A, 206, [0045] “a visual modification request includes a natural language text instruction or command that specifies one or more editing operations (e.g., brightness, hue, tone, saturation, contrast, exposure, removal), one or more adjustment types (e.g., increase, decrease, change, set), and/or one or more degrees of adjustments (e.g., a lot, a little, a numerical value)”, examiner interprets text instruction/command as content description);
Xu in view of Green in view of Wilson fails to teach further comprising instructions that, when executed by the at least one processor, cause the computing device to: identify, from an additional user account of the content management system, one or more additional content items associated with the additional user account; modify parameters of a content generation model based on the at least one attribute associated with the one or more content items and at least one additional attribute associated with the one or more additional content items; provide access to the custom content item to the user account and the additional user account.
However, Brandt teaches further comprising instructions that, when executed by the at least one processor, cause the computing device to: identify, from an additional user account of the content management system, one or more additional content items associated with the additional user account ([0078] FIG. 1, “the image editing system 104 provides functionality by which a client device (e.g., a user of one of the client devices 110a-110n) generates, edits, manages, and/or stores digital images”, examiner interprets the additional client devices to be linked to additional users);
modify parameters of a content generation model based on the at least one attribute associated with the one or more content items and at least one additional attribute associated with the one or more additional content items; provide access to the custom content item to the user account and the additional user account (FIG. 3, [0038] “the language-guided image-editing system 106 on the server device(s) 102 learns parameters for one or more neural networks…the client device 110 obtains (e.g., downloads) the language-guided image-editing system 106 with one or more neural network with the learned parameters from the server device. modified digital images in accordance with natural language requests independent from the server device(s) 102” [0054] “[0054] For example, FIG. 3 illustrates the language-guided image-editing system 106 learning parameters of an editing description neural network”)
provide access to the custom content item to the user account and the additional user account (FIG. 1, [0078-0079] “a client device sends a digital image to the image editing system 104 hosted on the server(s) 102 via the network 108. The image editing system 104 then provides options that the client device may use to edit the digital image, store the digital image, and subsequently search for, access, and view the digital image.”).
Xu in view of Green in view of Wilson in view of Brandt are considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of modifying digital content of Xu in view of Green in view of Wilson with the technique of generating custom content from additional users taught by Brandt in order to improve techniques for modifying digital images via scene-based editing using image understanding facilitated by artificial intelligence (see Brandt [Abstract]).
Regarding claim 18, Xu in view of Green in view of Wilson teaches all of the limitations of claim 16, upon which claim 18 depends.
Xu in view of Green in view of Wilson fails to teach further comprising instructions that, when executed by the at least one processor, cause the system to: receive, from the client device associated with the user account, one or more content item weights for the subset of content items; and generate the custom content item by utilizing the content generation model to synthesize the at least one attribute associated with the subset of content items within the custom content item based on the one or more content item weights.
However, Brandt teaches further comprising instructions that, when executed by the at least one processor, cause the system to: receive, from the client device associated with the user account, one or more content item weights for the subset of content items (FIG. 21A-21C, [0334] “the object modification neural network 1806 provides a soft grounding for textual queries via a weighted summation of the visual feature maps 1810. In some cases, the object modification neural network 1806 uses the textual features 1814a-1814b (represented as t∈custom-character.sup.1024×1) as weights to compute the weighted summation of the visual feature”); and
generate the custom content item by utilizing the content generation model to synthesize the at least one attribute associated with the subset of content items within the custom content item based on the one or more content item weights ([0229] “a real-world class description graph provides object attributes assigned to a given object, such as shape, color, material from which the object is made, weight of the object, weight the object can support, and/or various other attributes determined to be useful in subsequently modifying a digital image”).
Xu in view of Green in view of Wilson in view of Brandt are considered to be analogous to the claimed invention because both are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the techniques of modifying digital content of Xu in view of Green in view of Wilson with the technique of generating custom content from additional users taught by Brandt in order to improve techniques for modifying digital images via scene-based editing using image understanding facilitated by artificial intelligence (see Brandt [Abstract]).
Claim 20 is rejected under 35 U.S.C. 103 as being unpatentable over Xu in view of Green in view of Wilson in view of Nichoson in view of Brandt.
Regarding claim 20, Xu in view of Green in view of Wilson in view of Nichoson teaches all of the limitations of claim 19, upon which claim 20 depends.
Xu in view of Green in view of Wilson in view of Nichoson fails to teach further comprising instructions that, when executed by the at least one processor, cause the system to generate a version history for the content generation model by storing, for the user account of the content management system, the content generation model and the updated content generation model
However, Brandt teaches further comprising instructions that, when executed by the at least one processor, cause the system to generate a version history for the content generation model by storing, for the user account of the content management system, the content generation model and the updated content generation model ([0497] “the scene-based image editing system 106 automatically modifies the digital image 4306 (e.g., adjusts the brightness) using user preferences or user history. For instance, in some cases, the scene-based image editing system 106 tracks the settings typically used by the client device 4304 for a particular modification and implements those settings in response to selection of the selectable option”)
Xu in view of Green in view of Wilson in view of Nichoson in view of Brandt are considered to be analogous to the claimed invention because all are the same field of digital content transformation. Therefore, it would have been obvious to someone of ordinary skill in the art before the effective filing date of the claimed invention to have modified the digital editing techniques of Xu in view of Green in view of Wilson in view of Nichoson with the technique of generating a version history taught by Brandt in order to improve techniques for modifying digital images via scene-based editing using image understanding facilitated by artificial intelligence (see Brandt [Abstract]).
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure.
Benedetto et al. (US 20240193351 A1) teaches methods and system for generating an image for a user prompt provided by a user includes receiving the user prompt from the user. The user prompt is analyzed to detect text input and keywords included within. Keyword variations are provided to one or more keywords for user selection. An adjusted user prompt is generated by replacing keywords in the user prompt with keyword variations selected by the user. An image customized for the adjusted user prompt is generated to include image features that are influenced by content of the adjusted user prompt. The customized image providing a visual representation of the adjusted prompt is returned to a client device for rendering.
Yang et al. (US 20240257420 A1) teaches a data processing system implements techniques for automatically generating a presentation from a source document or a selection of a portion thereof. These techniques segment the document into a plurality of segments based on subject matter and transform those segments into textual content for slides for the presentation. The techniques also may selectively search for AI-generated and non-AI generated imagery to include in the slides for the presentation. These techniques provide safeguards for ensuring that AI-generated imagery is not utilized in instances in which such imagery would be inappropriate, misleading, or offensive. The techniques also provide means for user-specific control over when AI-generated imagery is utilized in the slides of an automatically generated presentation.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to ZEESHAN SHAIKH whose telephone number is (703)756-1730. The examiner can normally be reached Monday-Friday 7:30AM-5:00PM.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Richemond Dorvil can be reached at (571) 272-7602. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/ZEESHAN MAHMOOD SHAIKH/Examiner, Art Unit 2658
/RICHEMOND DORVIL/Supervisory Patent Examiner, Art Unit 2658
Prosecution Insights