codebert-base

by microsoft

Pre-trained model for code understanding and generation

513Kdl/month

284likes

125Mparams

HuggingFace Use in Pipeline

Identifiers

Model ID

microsoft/codebert-base

Feature URI

mixpeek://document_extractor@v1/microsoft_codebert_base_v1

Overview

CodeBERT is a bimodal pre-trained model for programming languages and natural language. It supports code search, code documentation generation, and code-to-code translation across 6 programming languages.

On Mixpeek, CodeBERT extracts and embeds code blocks from documents, enabling semantic search over code content, find code snippets by describing what they do in natural language.

Architecture

RoBERTa-base architecture (12 layers, 768-dim hidden, 12 attention heads) pre-trained on CodeSearchNet dataset with Masked Language Modeling and Replaced Token Detection on both NL and PL.

Mixpeek SDK Integration

import { Mixpeek } from "mixpeek";

const mx = new Mixpeek({ apiKey: "API_KEY" });

await mx.collections.ingest({
  collection_id: "my-collection",
  source: { url: "https://example.com/docs.pdf" },
  feature_extractors: [{
    name: "code_extraction",
    version: "v1",
    params: {
      model_id: "microsoft/codebert-base"
    }
  }]
});