LFM2-24B-A2B

LFM2-24B-A2B - Edge-Deployable Hybrid MoE Model

LFM2-24B-A2B is a Liquid AI model applying the hybrid LFM2 backbone in a sparse Mixture-of-Experts configuration.

Defining Characteristics

• Hybrid Backbone: 30 double-gated short-convolution blocks paired with 10 grouped-query-attention blocks (roughly a 1:3 attention-to-convolution ratio), with the first two layers kept dense for training stability.
• Sparse MoE Scaling: 64 experts per MoE block with top-4 routing; active parameters grow only ~1.5x while total parameters grow 3x versus LFM2-8B-A1B.

Why It Exists

Built to test whether the LFM2 hybrid backbone keeps scaling past its smaller siblings, while concentrating new capacity in total rather than active parameters so inference remains suitable for laptops and desktops.