​
1. Log In or Sign Up

  • If you have an account, log in using your preferred SSO or email/password combination.
  • If you’re new to FriendliAI, create an account for free.
Login

​
2. Access Friendli Serverless Endpoints

  • On your left sidebar, find the “Serverless Endpoints” option.
  • Click the option to access the playground page.
Sidebar

​
3. Select a Model

  • Browse available generative models. Choose the model that best aligns with your desired use case.
  • Click on a model that supports Friendli Serverless Endpoints to directly select the endpoint.
  • First-time user receives a free trial to explore Friendli Serverless Endpoints without any financial commitment.
Select Model

Select Endpoint

​
4. Generate Responses

  1. Enter Your Query:
  • Type in your prompt or question.
Chat Prompt
  1. Adjust Settings:
  • Refer to the Text Generation docs for more details on the settings applicable for the text generation models.
Chat Parameters
  1. Generate Your Response:
  • Click submit button to start the generation process.
  • The model will process your query and produce the corresponding text output. That’s it!
Chat Response

​
Generating Responses Through the Endpoint URL

If you wish to send your requests through the endpoint URL, you can find the model id by hitting the info button on the top-right corner of the page. Refer to this guide for general instructions on the Friendli Token.
Model Info

curl -X POST https://api.friendli.ai/serverless/v1/chat/completions \
  -H "Authorization: Bearer $FRIENDLI_TOKEN" \
  -d '{
    "model": "meta-llama-3.1-8b-instruct",
    "messages": [
      {
        "role": "user",
        "content": "Python is a popular"
      }
    ]
  }'

​
Additional Tips

Check out the Text Generation docs for more details. Ready to unlock the creativity of generative AI? Get started with Friendli Serverless Endpoints today!