-p 80:80
parameter when running the container, you can access the service inside the container by visiting http://localhost:80
or http://127.0.0.1:80
.
If you do need to use the container’s IP address directly, the steps above will assist you in obtaining this information.
http://127.0.0.1:9997
, and the default port is 9997
. By default, access is limited to the local machine only, but it can be configured with -H 0.0.0.0
to allow access from any non-local client. To modify the host or port, you can refer to xinference’s help information: xinference-local --help
.
If you use the Dify Docker deployment method, you need to pay attention to the network configuration to ensure that the Dify container can access the endpoint of Xinference. The Dify container cannot access localhost inside, and you need to use the host IP address.
http://127.0.0.1:9997
, select the model and specification you need to deploy, as shown below:
Running Models
page, such as: 2c886330-8849-11ee-9518-43b0b8f40bea
Settings > Model Providers > Xinference
, enter:
vicuna-v1.3
http://<Machine_IP>:9997
Replace with your machine IP address2c886330-8849-11ee-9518-43b0b8f40bea