Media creation with artificial intelligence: Difference between revisions
Paradox-01 (talk | contribs) |
Paradox-01 (talk | contribs) mNo edit summary |
||
| Line 52: | Line 52: | ||
Voice cloner / generator | Voice cloner / generator | ||
* | * [https://elevenlabs.io/ Elevenlabs] | ||
Music generator | Music generator | ||
Revision as of 22:15, 26 March 2026
Copyright and fair use
To understand the full picture of copyright, it is necessary to look at its real-world implementation.
Game companies have a strong interest in not upsetting their fan base, especially organized structures such as gaming communities.
Game communities function as voluntary support structures that provide services companies would otherwise need to fund themselves. Many of these contributions can be understood as direct or indirect sales promotion. These communities typically offer:
- First contact and general help for newbies.
- The creation of guides, tips and tricks, and even complete playthroughs.
- A space for like-minded people to socialize and exchange and develop ideas.
- Such spaces were forums in the past, nowadays they are real-time communication platform like a Discord channel which is thematically decorated and helps to keep the product in general awareness over long time frames.
- Communities pose a potential source for researching future products.
- Support in organizing competitions and other promotional events, including creative activities such as fan art. Cosplay contributions can increase a company's visibility at events like Gamescom.
- An additional channel for updates (general information and content announcements).
- Bug reporting and, in some cases, bug fixing. In rare instances, community members may even contribute to maintaining source code.
- Mods that improve replay value and thus increase overall customer satisfaction.
- Increased likelihood that fans will purchase other games and products (merchandise) from the company.
- A pool of trusted and engaged players who can be recruited as beta testers for new releases.
As a result, most companies also employ community managers. At least for active cash cows.
In practice, companies often tolerate limited uses of their intellectual property because they benefit from these activities. A strictly enforced copyright regime could suppress creative community contributions, reduce engagement, and ultimately harm the company itself.
However, this does not mean that copyright is overridden. In some cases, fan works may fall under fair use (depending on jurisdiction), but more often they exist within a space of informal tolerance or explicit licensing policies.
Game modifications (mods) often remain short of becoming independent games:
- Typically, they add optional 2D and 3D content, sometimes in large quantities. However, more fundamental changes - such as new game mechanics - often require access to or modification of the game engine and are therefore limited.
Generative AI (GenAI) has the potential to disrupt this cost–benefit balance:
- An automated large-scale production of new content based on existing assets may conflict with the company’s interests.
Considering the artists and technicians involved in creating the original work, mass-produced fan content generated at little or no cost could threaten established creative professions.
- An overabundance of derivative content may dilute attention and reduce consumer motivation to engage with official products.
The goal should be a form of symbiotic coexistence:
- Gaming communities should avoid creating direct competition with official products.
- In contrast to official expansion packs and DLCs, mods should generally not be placed behind paywalls.
As of 2026, conflicts arising from GenAI-driven mods remain largely hypothetical, but their relevance is likely to increase. In the long term, cooperative development models between companies and communities are conceivable, though this remains uncharted territory.
Possibilities and limitations
Generative artificial intelligence (GenAI) can ease and accelerate content creation. The difficulty of using or creating your own setups will continue to decrease with each newly released commercial forerunner model.
You can use GenAI via websites, desktop clients, or dedicated programs that may run fully locally.
To build your own programmatic solutions, you will either need downloadable AI models or API keys to access cloud services that perform the heavy computation remotely. With sufficient expertise, you can even build agentic AIs (such as Open Claw) that use your existing tools and carry out tasks automatically. However, caution is advised: Probabilistic AIs can hallucinate and may pose a risk to your system. Internally, MCP are used for more safety but these don't compensate to have backup means. Sandboxes offer an additional layer of safety, but they can limit the usefulness of agents and introduce extra complexity, which may offset the time savings you intended to achieve.
GenAI systems operate probabilistically. Do not expect identical results when repeating prompts with the same inputs. The same text prompts may produce similar, but not identical, outputs. Therefore, in some scenarios, it can be beneficial to generate multiple results and select the most suitable candidates for your intermediate or final goal.
Sounds, voice acting and music
For natural voices you may want to look for emotional text-to-speech.
Voice cloner / generator
Music generator
For professional-level fine-tuning you might want look at editors like Melodyn.
Images
- Content generation based on:
- Text prompts
- Own drafts
- Merging (main image and references)
- Changing existing content
- Expanding
- Inpainting (replacement of subsections)
- Style transfers
3D content
There exists content generators that turn 2D data into 3D data by calculating plausible assumptions for the missing dimension.
Tools
Images
Multimodal LLMs and plugins-using LLMs such as ChatGPT, Copilot, Gemini, Grok and Meta AI provide image generation capabilities.
- In addition, there are specialized tools (e.g., diffusion-based systems) that offer more control and customization. However, most users already have access to at least one of these platforms and can begin generating images immediately.
- For high-volume generation, a paid subscription or plan is typically required.
For image editing and post-processing, dedicated graphics software such as GIMP, Krita, or Photoshop is recommended. These tools allow precise control (e.g., masking, compositing, color correction) and can complement GenAI workflows.
Beginner workflow
Mini tutorial based on ChatGPT:
- Iterative prompting: Describe the desired result as clearly as possible: Motive, perspective, colors, lights, shadows, art style. Refine the prompt step by step based on undesired aspects rather than expecting a perfect result on the first attempt. Negative prompts: You can also explicitly write what you don't want.
- Avoid quality loss: If the GenAI degenerates the image quality because of too many iterations, try from a new start with combined text prompts.
- Reference images: When supported, provide one or more images to guide style, composition, or subject consistency. This is often more reliable than text-only prompting.
- Context management: If previous prompts begin to overly influence results, start a new prompt and explicitly restate the desired outcome. This prevents unintended bias from earlier context.
- Merging / composition: Supplying multiple images in a single prompt can help combine elements. However, repeated re-editing of generated outputs may degrade detail or introduce artifacts.
- Batch generation: Since outputs are probabilistic, generate multiple final candidates and select the best.
- Post-processing workflow: Combine the best elements using external tools (e.g., masking in Photoshop or Krita). This hybrid approach often yields higher-quality results than relying on a single generation.
Conclusion: Generate, refine via text prompts, select final candidates, refine via graphic tools.
In context of its limitations, this workflow is still great for rapid prototyping and exploring different creative directions for drafts.
(Add examples here.)
Advanced workflow
AUTOMATIC1111 (aka Stable diffusion), ComfyUI
Expert workflow
This would include to train own models. The idea is to let the models have an mental image of objects that equals screenshot-taking from 3D so that prompts will output images that almost never include hallucinated details.
Own models are interesting for rapid prototyping because they reduce the necessity to have a more complexer, combined 2D-3D-workflow.
Videos
Google Veo
Grok (xAI)
Sora (OpenAI)
- In 2026, Sora was announced to be discontinued. It will be probably just paused for a few years until future AI chips have lowered computation costs.
3D objects
- ...
3D animations
- ...
Complete world maps
- ...
- World generator inside Unreal Engine 5
- As for 2026, this is technically speaking still "procedural" but it is plausible to expect an LLM-driven approach in the future. On the internet you can find already LLM-driven experiments.