AI for Drafting Load Test Scripts from Endpoint Specs

End-of-lesson check

15 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-ai-coding-AI-load-test-script-drafting-creators

1. What does the term 'LLM scaffolding' refer to in the context of load testing?

   1. Using an LLM to generate an initial script structure that a developer then refines
   2. Manually writing test cases before running any automated tools
   3. Deploying LLMs directly into production to handle traffic
   4. Converting load test results into natural language reports

2. Given an OpenAPI specification snippet and a target RPS profile, what should an LLM be able to produce?

   1. A live deployment of the API with load balancing
   2. A fully tuned production-ready load test that needs no further changes
   3. A runnable k6 or Locust script skeleton ready for customization
   4. A video tutorial explaining how to run load tests

3. Why should production hostnames be kept out of prompts given to LLMs generating load test scripts?

   1. LLMs cannot read URLs properly and will generate syntax errors
   2. The generated script might accidentally be run against production, causing real impact or data corruption
   3. LLMs charge higher fees when URLs are included in prompts
   4. Production URLs are already included in OpenAPI specifications by default

4. What information does an OpenAPI specification provide that helps an LLM generate a load test script?

   1. Database connection strings and credentials
   2. The exact number of users currently using the API
   3. Endpoint paths, HTTP methods, request parameters, and expected response formats
   4. Historical traffic data from the last month

5. An LLM generates a load test script for your API. What can the LLM NOT know about your production environment?

   1. The specific HTTP methods your API supports
   2. The programming language used to write your API
   3. The names of your development team members
   4. Your actual traffic patterns, user behavior, and request frequency mix

6. Which of the following can an LLM typically add to a k6 load test script without additional configuration?

   1. Real user authentication tokens from production
   2. Custom load profiles based on actual customer behavior
   3. Database transactions to verify data integrity
   4. Basic threshold assertions checking for 2xx status codes and response times

7. In a k6 script with 'stages: ramp 0->50 VU over 1m, hold 5m', what does 'VU' stand for?

   1. Virtual Users
   2. Verified Users
   3. Visual Units
   4. Variable Utilization

8. What does the 'stages' configuration in a k6 load test script control?

   1. The programming language the script is written in
   2. Which database tables get queried during testing
   3. The color scheme of test result reports
   4. The duration and intensity of load over time

9. Why might an AI-generated load test script fail to replicate how real users actually use your API?

   1. The script contains syntax errors preventing execution
   2. AI uses different HTTP protocols than real browsers
   3. The script lacks knowledge of real user behavior patterns, request ordering, and business logic
   4. AI-generated scripts cannot make HTTP requests

10. What is Locust in the context of load testing?

    1. A cloud provider for hosting APIs
    2. An open-source load testing tool that uses Python
    3. A programming language for writing APIs
    4. A database management system

11. When generating load test scripts, what aspect of authentication flows might an LLM struggle with?

    1. Parsing JSON response bodies
    2. Sending GET requests without authentication
    3. OAuth flows, token refresh mechanisms, or session handling it cannot see in the API spec
    4. Implementing HTTP error codes

12. What is the primary purpose of varying payloads in a load test?

    1. To reduce the amount of data transferred over the network
    2. To simulate realistic data diversity and catch bugs that only appear with certain inputs
    3. To simplify the test script code
    4. To make the test take longer to complete

13. What does setting 'safe RPS' for downstream services mean in load testing?

    1. Testing with the highest possible request rate
    2. Using the slowest possible response time as a baseline
    3. Running tests only during business hours
    4. Ensuring generated load does not overwhelm services behind your API

14. Which tool uses JavaScript for writing load test scripts?

    1. Both k6 and Locust
    2. Locust
    3. Neither k6 nor Locust
    4. k6

15. Why is tuning a load test script for 'realism' important after an LLM generates the initial version?

    1. The LLM always generates syntactically invalid code
    2. The generated script might not reflect actual production traffic patterns, leading to misleading results
    3. LLM-generated scripts cannot be modified after creation
    4. Tuning is only needed for unit tests, not load tests