Relative Content

Tag Archive for node.jsexpostreamingopenai-apitsx

Open AI streaming NodeJS problems

async function handleChatGPTRequest(req, res) { let full =”” const chatHistory = req.body.updatedChat; console.log(chatHistory) try { const response = await openai.chat.completions.create({ messages: chatHistory, model: ‘gpt-4o’, max_tokens:90, stream: true, }); res.setHeader(‘Content-Type’, ‘text/event-stream’); res.setHeader(‘Cache-Control’, ‘no-cache’); res.setHeader(‘Connection’, ‘keep-alive’); for await (const chunk of response) { // console.log(chunk.choices[0]?.delta?.content || “”); let text = chunk.choices[0]?.delta?.content || “”; full += text console.log(full) […]