Lip Mask from Pose Keypoints

A ComfyUI custom node that generates precise mouth and lip masks from DWPose POSE_KEYPOINT output.

Installation

Copy this folder into your ComfyUI/custom_nodes/ directory:

ComfyUI/custom_nodes/lip_mask_from_pose/
├── __init__.py
├── lip_mask_node.py
└── README.md

Restart ComfyUI. The node appears under mask/pose → Lip Mask from Pose Keypoints.

Requirements

No additional dependencies — uses only numpy, cv2, and torch (already in ComfyUI).

Inputs

Input	Type	Description
pose_keypoint	POSE_KEYPOINT	Connect from DWPreprocessor's POSE_KEYPOINT output
mask_mode	Dropdown	Which mouth region to mask (see below)
blur_radius	INT (0-100)	Gaussian feathering radius. 0 = hard edge
grow_pixels	INT (0-200)	Dilate mask outward by N pixels
person_index	INT (0-99)	Which detected person (0 = first)
confidence_threshold	FLOAT (0-1)	Skip frames with low keypoint confidence

Mask Modes

• inner_mouth — Only the mouth cavity (teeth, tongue, dark interior). Leaves lips completely untouched during inpainting. Best for replacing teeth/smile without changing lip shape.

• outer_lips — Full lip region including lip skin. Use when you want to regenerate both lips and mouth.

• lips_only — Just the lip flesh (outer contour minus inner mouth). Regenerates lip shape/color while preserving the mouth interior.

• outer_expanded — Same as outer_lips but designed to be used with grow_pixels for a wider mask with soft falloff.

Typical Workflow

[Load Video] → [DWPreprocessor (detect_face=enable)]
                        ↓
                  POSE_KEYPOINT
                        ↓
              [Lip Mask from Pose Keypoints]
                        ↓
                      MASK → [WAN 2.2 VACE Inpaint / KSampler]

Face Landmark Reference (iBUG 300-W 68-point)

Outer lip contour:  indices 48-59  (12 points)
Inner lip contour:  indices 60-67  (8 points)

        48                         54
         49                       53
          50    51    52    53   52
    
    60                                 64
       61                           63
          62          63          62
             (inner mouth opening)
    
        67                         65
           66                   66

Tips

• For teeth-only inpainting: use inner_mouth + grow_pixels=3 + blur_radius=5
• For lip reshaping: use outer_lips + blur_radius=8 for soft blend
• Combine with SAM-2 for even more precise boundaries: use this mask as a coarse region, then refine with SAM point prompts placed at the mask centroid