開源flux-lora-rtmi模型 - 實現文本到圖像轉換，生成《重返猴島》風格圖片

首頁

Flux Lora Rtmi

由lichorosario開發

基於《重返猴島》遊戲截圖訓練的Flux LoRA模型，用於生成RTMI風格的文本到圖像轉換。

圖像生成英語開源協議:其他 #重返猴島風格 #卡通角色設計 #遊戲場景生成

下載量 29

發布時間 : 8/27/2024

模型概述

該模型是一個基於擴散模型的LoRA適配器，專門用於生成具有《重返猴島》遊戲風格的圖像。通過文本提示詞觸發，能夠生成卡通化、誇張風格的場景和角色設計。

模型特點

RTMI風格生成

專門生成具有《重返猴島》遊戲獨特卡通風格的圖像

LoRA適配器

作為輕量級適配器，可在基礎模型上靈活調整生成風格

高分辨率輸出

支持1024x1024高分辨率圖像生成

模型能力

文本生成圖像

風格化圖像生成

角色設計

場景設計

使用案例

遊戲設計

遊戲角色設計

生成具有RTMI風格的遊戲角色形象

如示例中的程序員蓋布拉什角色

遊戲場景設計

創建誇張卡通風格的場景

如示例中的電視巢穴和海灘場景

概念藝術

概念插畫

快速生成風格化概念藝術

如示例中的懸崖和餐廳場景

🚀 Flux Lora Rtmi

這是一個基於 《重返猴島》（Return to Monkey Island） 遊戲截圖訓練的 Flux Lora 模型，可用於文本到圖像的生成。它藉助 Replicate 平臺進行訓練，為圖像創作帶來獨特風格。

🚀 快速開始

觸發詞

使用 RTMI 來觸發圖像生成。

使用 🧨 diffusers 庫

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('lichorosario/flux-lora-rtmi', weight_name='lora.safetensors')
image = pipeline('your prompt').images[0]

📦 安裝指南

暫未提供具體安裝步驟，可參考上述代碼示例進行使用。

💻 使用示例

基礎用法

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('lichorosario/flux-lora-rtmi', weight_name='lora.safetensors')
image = pipeline('your prompt').images[0]

高級用法

# 可根據文檔中提供的示例提示詞，替換 'your prompt' 以生成不同風格的圖像
# 例如：
prompt = 'RTMI style. Guybrush threepwood,  a tall man with blonde hair, wearing a blue pirate coat with gold accents. He has a white shirt underneath, a belt with a gold buckle, and dark pants. His expression is thoughtful, and he has a slight stubble on his face, adding to his adventurous appearance. Guybrush is programming with many computers. Cyberpunk style.'
image = pipeline(prompt).images[0]

📚 詳細文檔

模型信息

屬性	詳情
模型類型	文本到圖像的 LoRA 模型
基礎模型	black-forest-labs/FLUX.1-dev
訓練數據	《重返猴島》（Return to Monkey Island）遊戲截圖
推理參數	寬度：1024，高度：1024

示例提示與輸出

示例標題	提示詞	輸出圖片
Guybrush programmer	RTMI style. Guybrush threepwood, a tall man with blonde hair, wearing a blue pirate coat with gold accents. He has a white shirt underneath, a belt with a gold buckle, and dark pants. His expression is thoughtful, and he has a slight stubble on his face, adding to his adventurous appearance. Guybrush is programming with many computers. Cyberpunk style.	samples/guybrush-programmer.png
Tv nest	RTMI style. An empty interior scene just inside the entrance of a towering building constructed and inhabited by cockroaches. The perspective is distorted and cartoonish, with the camera positioned as if you're standing just past the grand, slightly arched door that leads into the building. The interior is a labyrinth of narrow, winding corridors that twist and turn unpredictably, with passageways leading up, down, and in all directions, creating a sense of disorientation. The ceiling, walls, and floors are all pristine white, with the floor retroilluminated, casting a soft glow upwards. The hallways have a sleek, futuristic appearance, but are still dimly lit, with shadows that accentuate the strange angles of the walls. The retro-style TVs embedded in the walls have bright orange plastic casings, while the screens emit a soft, white light. The screens are tilted at odd angles, flickering with static or displaying quirky, old-school TV shows, adding a nostalgic glow to the cold environment. The staircases are modern and minimalist, without handrails, their black steps creating a stark contrast against the white surroundings. The stairs spiral upward in erratic directions, some leading to higher floors, while others abruptly end in dead ends. The stairways are crooked, with steps of varying heights and widths, enhancing the building’s surreal, disjointed atmosphere. The white walls are adorned with subtle, recessed cockroach logos, creating an embossed effect that adds texture and detail to the otherwise smooth surfaces. Additional doors are scattered throughout the corridor, some leading to hidden rooms, while others open into completely dark tunnels. The hallways also bifurcate in places, with some passages leading into these pitch-black tunnels, creating a sense of mystery and unease. The entire scene is bathed in a mix of dim lighting from the ceiling, the soft glow from the floor, and the eerie light of the orange TVs, creating a mysterious and slightly unsettling atmosphere.	samples/tv-channel.png
Restaurant outdoor	RTMI style. textured paper collage The paper texture is very visible. There are different textures. The papers are handmade painted with watercolor and crayons. An empty stylized game background scene using muted colors, mainly blue, yellow, orange, black and violet. A winding path crosses the screen, curving from the top left to the bottom right. Below the path, whimsical trees with irregular, bulbous shapes and playful, swirling bushes fill the scene. To the right stands a cozy, old-fashioned restaurant with large glass windows, through which warm, soft light spills onto the empty street. Inside, simple wooden tables and chairs are arranged neatly, but the restaurant is vacant, giving it a peaceful, quiet vibe. The restaurant's exterior features a large, aged wooden sign, slightly crooked, with an oversized fork carved into it and the text "Crespín Restorán" in quirky, uneven letters. Outside, a few tufts of grass poke through the cracks of the weathered sidewalk tiles, adding to the rustic charm. The night sky above is dark, with a crescent moon shining softly, casting gentle shadows. The street is empty and lonely, illuminated by a few antique-style street lamps that emit a dim, warm light, contrasting with the cold, bluish light of the street itself. The lamps are bent and irregular, with wavy lines, and their light creates playful, wavy reflections on the pavement. The visual style in these images can be characterized as highly exaggerated and car.	samples/restaurant-outdoor.png
Beach	RTMI game background design. Fisheye lens panorama background for a point-and-click game. The horizon is curvy, and the scene is viewed from a low angle on a deserted beach with soft, golden sand. In the foreground, gentle waves of the deep blue ocean lap against the shore. Far in the distance, a steep cliff rises dramatically from the beach, and perched on top is a very large wooden cabin with a rustic, adventurous design. The cabin features a thatched roof and sturdy log walls in various shades of brown. A winding dirt path carves its way up the cliffside, connecting the beach with the cabin above. Below the cliff, a small wooden pier extends into the water, where a boat is gently swaying in the breeze. On the distant horizon, a small picturesque village resembling Capri is nestled on a hill, its buildings barely visible against the bright, sunny sky. The entire scene is peaceful and tranquil, with the sun casting a warm light over the landscape, while the sense of adventure lingers in the air from the towering cliff and the solitary wooden cabin above. . This visual style is defined by a strong emphasis on exaggerated forms and dynamic compositions. The shapes throughout are distorted and twisted, moving away from realistic representations and instead creating a world that feels fluid and constantly in motion. Buildings and objects often appear bent, curved, or skewed, giving the environment a surreal quality that emphasizes a playful and imaginative tone. The architecture seems to defy gravity, with structures leaning at odd angles, contributing to the overall whimsical feel. Perspective is another key aspect of this style, where traditional rules are intentionally bent or broken. Instead of using a realistic vanishing point, the perspective often resembles a wide-angle or fisheye lens, with objects stretching and warping as they recede into the distance. This creates a sense of depth that is exaggerated and immersive, drawing the viewer into the scene while maintaining a distinctly stylized and cartoonish appearance. Lighting is used to define the shapes and enhance the sense of depth and dimension. Highlights and shadows are applied in a bold, almost graphic manner, bringing out the contours of the objects and creating a strong contrast between different elements. This approach adds to the overall dynamism of the composition, making the scenes feel energetic and full of life. The compositions themselves are carefully structured to guide the viewer’s eye across the scene. The use of exaggerated perspective and distorted shapes creates a visual flow that leads from one area to another, encouraging exploration and engagement with the environment. This sense of movement within the static image helps to reinforce the idea of a world that is in constant flux, where nothing is quite as it seems. Overall, the style focuses on distortion, dynamic perspective, and strong lighting to create an engaging and surreal visual experience. The world feels lively and imaginative, with every element contributing to a cohesive and playful aesthetic that invites the viewer into its unique and fantastical universe.	samples/beach-01.png
Cliff	RTMI illustration style. View from a cliffside lookout, looking down towards large rocks and the ocean below. The edge of the cliff is covered in rough, gray rocks with small cracks and patches of resilient vegetation growing between them. The deep blue ocean below gently crashes against the rocks at the base of the cliff, creating swirls of white foam. Some of the rocks are partially submerged in water, while others jut out, weathered by the waves. On the right, the ocean extends toward the horizon, with the sunlight reflecting off the water, creating bright glimmers. The sky above is clear, with soft sunlight bathing the scene. The atmosphere is peaceful, with soft shadows cast on the rocks and water. The base of the cliff is composed of dark, rugged rocks with patches of algae that catch the light, while gentle waves leave traces of foam as they break against the rocks. . The visual style in these images can be characterized as highly exaggerated and cartoonish, with a playful use of perspective and distortion. The style features bold and vibrant color schemes, where each area of the scene uses a limited but intense palette, allowing the shapes and forms to stand out sharply. These colors are often applied in large, flat planes, giving the visuals a somewhat graphic novel-like quality, even though they are rendered with a painterly texture. The perspective is notably warped, creating an almost fisheye lens effect in some cases. This warping is especially evident in how walls and floors curve unnaturally, as if the viewer is seeing the scene through a distorted lens. This creates a surreal and exaggerated space that enhances the whimsical and absurd nature of the scenes. Shapes are angular, with a mix of sharp and flowing lines. There’s a clear emphasis on abstraction, where objects and architectural elements are simplified to their most recognizable forms but are bent and twisted to fit the playful tone of the scene. The use of negative space is also significant, where shadows and silhouettes create dynamic contrasts, further adding to the overall exaggerated aesthetic. The perspective does not follow strict rules of realism. Instead, it is dynamically altered to guide the viewer’s eye across the scene, often leading to a sense of depth through exaggerated angles. The lens-like distortion pulls the edges of the scene outward, creating a sense of expansion, as if the environment is stretching away from the viewer. This helps to create a visually engaging and immersive experience, despite the flatness of the color application. Overall, the style combines vibrant, exaggerated color with distorted shapes and a playful approach to perspective, resulting in a visually unique and whimsical world that feels both surreal and immersive. The style is a collage that emphasizes texture and a handmade feel. Use simple geometric shapes cut from textured paper, incorporating a mix of rough, uneven edges to mimic the look of hand-torn paper. Incorporate crayon or pastel-like effects on some of the elements, adding a slightly uneven, grainy texture. The colors should be soft and muted, with subtle variations in hue, as if lightly shaded or colored by hand. The background should have a textured, almost sponge-like appearance, with visible brush strokes or speckled effects. Overall, the piece should have a playful, handcrafted look, combining the rough, tactile qualities of traditional collage with the expressive, childlike feel of crayon or pastel artwork.	samples/punta-01.png
Singers	RTMI cartoon character design. The image shows two singers passionately performing on stage, both holding microphones and singing with great emotion. The man on the left is bald, with a neatly trimmed beard and wearing a dark blue suit jacket over a white shirt. His head is tilted slightly upward as he sings, with his mouth wide open, conveying intensity and energy. His right hand grips the microphone tightly, and his left hand is extended outwards, as if emphasizing the power of his performance. To his right is a woman with long, curly blonde hair cascading over her shoulders. She is wearing a black, sparkling dress with a deep neckline, and she too is singing with enthusiasm. Her expression is powerful, with her mouth open wide as she belts out a note. She holds her microphone in her right hand, while her left hand is extended in a dramatic gesture, as if reaching out to the audience. She wears a watch on her left wrist and a ring on her right hand, adding to her glamorous appearance. The background features a stage with a decorative backdrop that includes a large circular design in shades of yellow and orange, resembling an abstract sun. Overhead, green stage lights illuminate the scene, casting a vibrant glow on the performers. Behind them, a dark curtain provides contrast, making the singers stand out even more. The atmosphere is lively, with the lighting and their dynamic expressions capturing the essence of a passionate performance.	samples/singers-01.png
Spiderman	RTMI style. illustration of spiderman at the comic con	samples/spiderman.png
Monna Lisa	RTMI style. character design. The image depicts Monna Lisa by leonardo da vinci in cartoon RTMI style.	samples/monna-lisa-03.png
室內男子	RTMI cartoon style character design. This image captures a casual indoor scene, likely taken in a clothing store or a wardrobe area filled with various garments. The focal point is a caucasian man standing in the center, smiling broadly with a friendly, relaxed expression. The overall style evokes a playful, almost retro vibe. The man is wearing a tight-fitting, long-sleeved gray shirt, which closely follows the contours of his body. The man has sweaty armpits in darker color. Around his neck, he is wearing a tan and beige checkered scarf, loosely wrapped but still snug enough to stand out as a fashion accessory. The scarf's texture appears soft, perhaps woolen or knit, and it adds an element of warmth and contrast to his otherwise sleek outfit. In the background, the space is organized with shelving and clothing displays. On the left, a shelving unit holds a few folded garments, including shirts or sweaters, neatly stacked in different colors. Next to him on the countertop is a black shopping bag adorned with white and green designs and text, possibly from the store itself. A vibrant green ribbon is attached to the bag, adding a pop of color. Behind him, part of the shelving has decorative items, including what looks like a small piece of art or signage featuring bold black and white graphics. To the right of the man, a bright green curtain is partially visible, which may be a fitting room or divider within the space. The lighting in the room is moderate, with a soft glow illuminating the scene evenly, giving it a clear, well-lit appearance without harsh shadows. The atmosphere feels casual and perhaps a bit playful, given the man's fashionable and somewhat whimsical look. the man's hairstyle is a striking feature, characterized by a mix of textures that gives it a carefully styled yet relaxed appearance. His hair is dark, likely black or very dark brown, with a healthy, shiny finish. The style is divided into two distinct textures: a sleek, straight fringe (bangs) at the front, and voluminous, professionally styled curls throughout the rest of the hair. The fringe is straight and falls neatly over his forehead, with several strands parted slightly in the middle. The bangs are relatively long, reaching just above his eyebrows. The hair is smooth and flat against his forehead, providing a sharp contrast to the more voluminous curls behind it. The straightness of the fringe is likely intentional, adding a polished, elegant touch to his look. The rest of his hair, in contrast, is full of soft, bouncy curls, similar to those created with a curling iron or from a salon blowout. These curls start at the sides of his head and flow outward, adding significant volume and a lively texture. The curls are medium in size, not too tight but defined enough to create a dynamic, flowing look. The back of his hair maintains this voluminous curl pattern, rounding out the shape of his hairstyle and giving it a balanced, full appearance. This blend of sleek, straight bangs with voluminous curls creates a unique juxtaposition, adding both sophistication and a touch of playfulness to his overall style. The hairstyle feels modern but with a nod to vintage influences, combining the precision of straight bangs with the soft glamour of big, flowing curls. It’s clear that this look has been styled with care, likely in a salon setting, to achieve this distinct mix of textures. The curls go down the shoulders	images/example_b7k8vrb7y.png