Good news from the delivery room! The new command “ –cref ” aims to match the character with the “character reference” image. Note: This command update is attached to the Midjourney V6 testing phase and will change before the official version is released.
The official instructions provided how to use it, its purposes, and advanced features.
· Type –cref URL, where URL is the web address of a character image
· You can use –cw to modify the ‘strength’ of the reference, from 0 to 100 – strength 100 (–cw 100) is the default, using face, hair, and clothing. At strength 0 (–cw 0), it will only focus on the face (suitable for changing clothing/hairstyle, etc.)
· This feature works best when using characters made by Midjourney images.
· It does not apply to real people/photos (and may distort them like regular image prompts) Cref works similarly to regular image prompts, but it “focuses on” character features.
· The accuracy of this technique is limited; it will not replicate exact dimples/freckles/or T-shirt logos. Cref works with Niji and standard MJ models and can be combined with –sref.
You can use multiple URLs to mix information/characters from multiple images, like this –cref URL1 URL2 (this is similar to multi-image or style prompts)
How It Works in Web Alpha (Initial Testing Version)
· Drag or paste images into the imagination bar, now there are three icons. Choose these icons to set it as an image prompt, a style reference, or a character reference.
I randomly selected an image in the MJ web community, clicked the image icon button below the arrow (Figure 1), selected these three buttons in the upper input bar (the first one in the red box is the character reference, click the icon), added descriptive words, adjusted the settings (Figure 3), and pressed Enter to achieve a change in the scene while keeping the character’s face unchanged (Figure 4).
· Hold the Shift key to select an option to use the image for multiple categories
Remember, while MJ V6 is still in the alpha testing phase, this and other features may change suddenly, but the official beta version of V6 is coming soon.
This channel details the usage and issues that arise.
Link: https://discord.com/channels/662267976984297473/1216877089286787222
1. Character Reference (or –cref) will help you achieve roughly the same character across different images
In this case, “character” refers to any type of humanoid image.
The –cref parameter allows us to create roughly similar characters based on the existing character image provided via URL.
Example:Jo is a young woman with blue curly hair, pink sunglasses, and a colorful scarf around her neck. Jo waits in line at the bank. In the style of Teen Magazine photography. –cref https://my.image.host/jo-is-standing.jpg
Translation:Jo is a young woman with blue curly hair, pink sunglasses, and a colorful scarf around her neck. Jo is waiting in line at the bank. In the style of Teen Magazine photography.
By using the –cref parameter, we can stabilize the appearance of the character across all images. It helps if the character has distinctive features.
Note:Character details will still be influenced by arrangement and randomness . You may try using prompts to anchor missing details. See more information below!
Character attributes that work well for the –cref parameter include:
· Distinctive iconic features: blue-green curly hair, pink sunglasses, knee-length trench coat, green backpack
Character attributes that do not work well for the –cref parameter include:
· Minor details: a silver pendant necklace with eight small pyramid-shaped gems, a leather jacket missing the left sleeve with “ZOOM” written on the back, a hairstyle with infinity symbols shaved on both sides of the jacket.
2. Accurate Usage Methods
· Choose the right prompting method
There are three key methods for prompting using –cref. You can anchor details (pose, expression, emotion, clothing, props, scene, action) so you can control them; you can give a light touch and let –cref do most of the work; or you can only provide the scene to the character and let –cref do all the work.
In all three cases, the prompts will mix with any character attributes that Midjourney can recognize from the cref image you provide. Your prompts can be used to anchor important details of the character or let the cref image contribute everything.
· Examples of prompts anchoring important character details:
Notice how the prompts emphasize iconic character attributes present in the reference image. It also “manipulates” or “positions” the character.
Example:Jo is a young woman with blue curly hair, pink sunglasses, and a colorful scarf around her neck. She waits in line at the bank. –cref https://my.image.host/jo-is-standing.jpg
Translation:Jo is a young woman with blue curly hair, pink sunglasses, and a colorful scarf around her neck. She is waiting in line at the bank. –cref https://my.image.host/jo-is-standing.jpg
· Non-intrusive prompts that do not need to repeat iconic details:
Notice that this prompt does not attempt to reinforce any iconic details present in the reference image; it simply “manipulates” or “positions” the character. Someone is waiting in line at the bank. –cref https://my.image.host/jo-is-standing.jpg
· If your cref image already contains the pose and other details you want, there is a third way available:
You can simply describe the environment, surroundings, background, or context. Midjourney will strive to place the character into the scene. If you choose this approach, you may see some incoherent results. If so, try using a higher stylization value (e.g., –s 800).
· Example of a scene-only prompt:
Notice that this prompt does not even mention the character, showing confidence in Midjourney’s ability to place the character. In an empty wasteland, under a stormy sky with dark clouds. –cref https://my.image.host/jo-is-standing.jpg
Note:–cref command is suitable for images with a single subject and a single character. If you plan to add multiple characters to the scene, you need to use the pan button to add them.
3. If I am using cref, how do I place multiple characters on one canvas
The best way to place multiple characters based on cref onto a single canvas is to use the pan feature to stitch the new canvas together with the existing canvas. Each new canvas section will have its own cref.
1.Use /settings to turn on Remix, then select [High Variation Mode / High Variation]
2.Select the image that will contain the second character, then use U to separate it from the grid.
3. Look for the blue arrows. ⬆️⬇️⬅️➡️ Each will add a new image to the existing image. Choose the direction for the new character and enter the prompt along with its –cref. This will stitch a new canvas together, like the character above.
Note:Set the canvas to depict the opening prompt for two people.
Example:Two people standing in the forest. Ezra is a husky adult plump male wearing red glasses. He has an undercut short black buzzcut hairstyle. He is a gamer-nerd dressed in layers, a dark undershirt, an overshirt, hipster boho stylish fashion. He wears a teal overshirt and thick plastic red eyeglasses. –cref https://s.mj.run/dCsjeI5AflU –ar 3:2
Translation:Two people standing in the forest. Ezra is a husky adult plump male wearing red glasses. He has a short black hairstyle. He is a layer-dressed gamer nerd, wearing a dark undershirt and an overshirt, in stylish hipster bohemian fashion. He wears a teal overshirt and thick plastic red eyeglasses. –cref https://s.mj.run/dCsjeI5AflU –ar 3:2
Repeat this process as needed, but be careful not to overdo it, as it may lose fidelity.
4. Add your character reference image and select a –cw (cref weight) to achieve the effect
The character attributes that Midjourney can recognize from the reference image will mix with the prompt to create the final representation of your character.
You can roughly control the transfer by using the –cw N parameter (cref weight), where N can range from 1 to 100. The default is 100.
Note: The –cw parameter does not change the strength/influence of the character reference image, The effects of the –cw parameter:
· A value of –cw 100 (default) will capture the entire character.
· Values between –cw 99 and –cw 1 will start capturing less of the whole character, focusing only on the transfer of the face.
· A value of –cw 0 will only capture the face, roughly similar to face replacement.
· You cannot turn off the transfer of the face.
CREF Troubleshooting Tips
Things you need to know or exclude.
1. I cannot give the character a new pose, style, or detail
Sometimes, your character may resist manipulation.
First, make sure you write a strong prompt suggesting a new pose, style, or detail.
If the prompt seems strong, the problem may be that the cref image dominates the prompt.
This can be addressed by using –cw (cref weight). The –cw N parameter can take values from 1 to 100, with a default of 100.
· Try using your prompt with a lower cref weight, like –cw 60, which will slightly release the control of cref, allowing the prompt to manipulate your character more freely.
· Using this method may compromise similarity, especially if your cref weight (–cw) needs to be lower than 40.
· If similarity is lost, use /settings to ensure you are in [Low Variation/Low Variation] mode and that Remix is set to on. Now create a variant of your favorite image (V).
· You have turned on Remix, so now you can edit the prompt, gradually increase –cw to higher values, and repeat this process until similarity is restored.
Sidebar: If this method starts to erase the pose, you can always consider using [Vary Region] to restore the face area with a higher –cw value.
2. I cannot change my character’s face, especially if the face is “locked”
This is correct.
Midjourney strives to preserve the face when cref is in effect, regardless of the value of –cw. In fact, when you set –cw to 0, you are asking Midjourney to transfer only the face to the new image. Midjourney will always retain the iconic attributes of the face, such as beard and glasses. If you want to change the face, do it in another tool. If that is not feasible, you can try using this process.
Follow these steps:
· Use /settings to ensure you are in [Low Variation/Low Variation] mode and that Remix is set to on.
· Select the image with the face you want to change. Use (U) to separate it from the grid, then select [Vary Region].
· Since you have turned on Remix, you will be able to edit the prompt.
· Remove –cref and –cw from the prompt. Once removed, modify the prompt to change the face. For example, you could generously select the lower half of the face and add “clean-shaven” to remove the beard. You can try using small negative weights, such as tattoos ::-0.5 to remove tattoos. This is an area for you to explore and discover, depending on your goals.
Note: When you are satisfied with the changes, make sure not to add –cref back into the prompt! Once added back, the
