Dialogue systems
2018-10-12 本文已影响18人
一梦换须臾_
开坑 以后再填
Reference
Conclusion(可以选择下面链接中提到的模型):
Dialogue System 总结
End-to-end task-oriented Dialogue System
A Survey of Available Corpora for Building Data-Driven Dialogue Systems
Dialogue System Model:
-
A basic dialogue model based on belief tracker
A Network-based End-to-End Trainable Task-oriented Dialogue System -
Neural methods for state tracking
Neural Belief Tracker: Data-Driven Dialogue State Tracking -
Memory to sequence, based on memory of dialogue conversations & Knowledge Base, instead of slot-filling
Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems -
Large-Scale Multi-Domain Belief Tracking with Knowledge Sharing
-
Conditional Generation and Snapshot Learning in Neural Dialogue Systems
Terminology
LU : Language Understanding
RL : Reinforcement Learning
LG : Language Generation
SLOT : the key which specify attributes of Database key-value pairs
ACT : user intent
Mem2Seq
Overview
论文参见: Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems
项目参见: Mem2Seq
Data
#navigate#
0 2_miles road_block_nearby parking_garage poi dish_parking
0 dish_parking distance 2_miles
0 dish_parking traffic_info road_block_nearby
0 dish_parking poi_type parking_garage
0 dish_parking address 550_alester_ave
0 6_miles no_traffic parking_garage poi stanford_oval_parking
0 stanford_oval_parking distance 6_miles
0 stanford_oval_parking traffic_info no_traffic
0 stanford_oval_parking poi_type parking_garage
0 stanford_oval_parking address 610_amarillo_ave
0 4_miles car_collision_nearby grocery_store poi willows_market
0 willows_market distance 4_miles
0 willows_market traffic_info car_collision_nearby
0 willows_market poi_type grocery_store
0 willows_market address 409_bollard_st
0 2_miles moderate_traffic rest_stop poi the_westin
0 the_westin distance 2_miles
0 the_westin traffic_info moderate_traffic
0 the_westin poi_type rest_stop
0 the_westin address 329_el_camino_real
0 1_miles heavy_traffic friends_house poi toms_house
0 toms_house distance 1_miles
0 toms_house traffic_info heavy_traffic
0 toms_house poi_type friends_house
0 toms_house address 580_van_ness_ave
0 4_miles heavy_traffic pizza_restaurant poi pizza_chicago
0 pizza_chicago distance 4_miles
0 pizza_chicago traffic_info heavy_traffic
0 pizza_chicago poi_type pizza_restaurant
0 pizza_chicago address 915_arbol_dr
0 6_miles car_collision_nearby gas_station poi valero
0 valero distance 6_miles
0 valero traffic_info car_collision_nearby
0 valero poi_type gas_station
0 valero address 200_alester_ave
0 2_miles no_traffic chinese_restaurant poi mandarin_roots
0 mandarin_roots distance 2_miles
0 mandarin_roots traffic_info no_traffic
0 mandarin_roots poi_type chinese_restaurant
0 mandarin_roots address 271_springer_street
1 where s the nearest parking_garage the nearest parking_garage is dish_parking at 550_alester_ave would you like directions there ['parking_garage', '550_alester_ave', 'dish_parking']
2 yes please set directions via a route that avoids all heavy_traffic if possible it looks like there is a road block being reported on the route but i will still find the quickest route to 550_alester_ave ['550_alester_ave']
3 thanks so much for your help you re very welcome []
{
"dialogue": [
{
"turn": "driver",
"data": {
"end_dialogue": false,
"utterance": "where's the nearest parking garage"
}
},
{
"turn": "assistant",
"data": {
"end_dialogue": false,
"requested": {
"distance": true,
"traffic_info": false,
"poi_type": true,
"address": true,
"poi": false
},
"slots": {
"distance": "nearest",
"poi_type": "parking garage"
},
"utterance": "The nearest parking garage is Dish Parking at 550 Alester Ave. Would you like directions there? "
}
},
{
"turn": "driver",
"data": {
"end_dialogue": false,
"utterance": "Yes, please set directions via a route that avoids all heavy traffic if possible. "
}
},
{
"turn": "assistant",
"data": {
"end_dialogue": false,
"requested": {
"distance": false,
"traffic_info": true,
"poi_type": false,
"address": false,
"poi": true
},
"slots": {
"traffic_info": "avoid heavy traffic ",
"poi": "dish parking"
},
"utterance": "It looks like there is a road block being reported on the route but I will still find the quickest route to 550 Alester Ave. "
}
},
{
"turn": "driver",
"data": {
"end_dialogue": false,
"utterance": "Thanks so much for your help. "
}
},
{
"turn": "assistant",
"data": {
"end_dialogue": true,
"requested": {
"distance": false,
"traffic_info": false,
"poi_type": false,
"address": false,
"poi": false
},
"slots": {},
"utterance": "You're very welcome!"
}
}
],
"scenario": {
"kb": {
"items": [
{
"distance": "2 miles",
"traffic_info": "road block nearby",
"poi_type": "parking garage",
"address": "550 Alester Ave",
"poi": "Dish Parking"
},
{
"distance": "6 miles",
"traffic_info": "no traffic",
"poi_type": "parking garage",
"address": "610 Amarillo Ave",
"poi": "Stanford Oval Parking"
},
{
"distance": "4 miles",
"traffic_info": "car collision nearby",
"poi_type": "grocery store",
"address": "409 Bollard St",
"poi": "Willows Market"
},
{
"distance": "2 miles",
"traffic_info": "moderate traffic",
"poi_type": "rest stop",
"address": "329 El Camino Real",
"poi": "The Westin"
},
{
"distance": "1 miles",
"traffic_info": "heavy traffic",
"poi_type": "friends house",
"address": "580 Van Ness Ave",
"poi": "toms house"
},
{
"distance": "4 miles",
"traffic_info": "heavy traffic",
"poi_type": "pizza restaurant",
"address": "915 Arbol Dr",
"poi": "Pizza Chicago"
},
{
"distance": "6 miles",
"traffic_info": "car collision nearby",
"poi_type": "gas station",
"address": "200 Alester Ave",
"poi": "Valero"
},
{
"distance": "2 miles",
"traffic_info": "no traffic",
"poi_type": "chinese restaurant",
"address": "271 Springer Street",
"poi": "Mandarin Roots"
}
],
"column_names": [
"poi",
"poi_type",
"address",
"distance",
"traffic_info"
],
"kb_title": "location information"
},
"task": {
"intent": "navigate"
},
"uuid": "118f8056-0e66-43df-8eb8-bfe9056ca01a"
}
}
Train
10-19 09:55 Read 6290 sentence pairs train
10-19 09:55 Read 777 sentence pairs dev
10-19 09:55 Read 807 sentence pairs test
10-19 09:55 Max len Input 265
10-19 09:55 Vocab_size 1554
10-19 09:55 USE_CUDA=True
10-19 09:55 Epoch:0
L:6.43, VL:4.58, PL:1.85: 100%|███████████████| 787/787 [01:35<00:00, 8.26it/s]
10-19 09:57 Epoch:1
L:5.33, VL:3.71, PL:1.62: 100%|███████████████| 787/787 [01:37<00:00, 8.97it/s]
10-19 09:59 Epoch:2
L:5.02, VL:3.46, PL:1.55: 100%|███████████████| 787/787 [01:37<00:00, 8.03it/s]
10-19 10:00 STARTING EVALUATION
R:0.0944,W:69.8773: 100%|███████████████████████| 98/98 [00:32<00:00, 3.16it/s]
10-19 10:01 F1 SCORE: 0.11454102355808286
10-19 10:01 F1 CAL: 0.24846625766871167
10-19 10:01 F1 WET: 0.10515021459227468
10-19 10:01 F1 NAV: 0.025056947608200455
10-19 10:01 BLEU SCORE:6.39
10-19 10:01 MODEL SAVED
10-19 10:01 Epoch:3
L:4.81, VL:3.30, PL:1.51: 100%|███████████████| 787/787 [01:38<00:00, 7.97it/s]
10-19 10:02 Epoch:4
L:4.74, VL:3.24, PL:1.50: 100%|███████████████| 787/787 [01:38<00:00, 7.40it/s]
10-19 10:04 Epoch:5
L:4.53, VL:3.08, PL:1.45: 82%|████████████▎ | 643/787 [01:20<00:19, 7.40it/s]
Sample
Pre-trained Model: BLEU 11.78
| User | Response | Gold |
|---|---|---|
| what gas_stations are here | there is a p_.f_._changs located 1_miles away would you like directions there | there is a chevron |
| that s good please pick the quickest route to get there and avoid all heavy_traffic | there there is heavy_traffic on the quickest route but since it s just 1_miles away it is only 1_miles away the gps you should reach the address of the route to home to get there | taking you to chevron |
| what is the address | the is taking chevron at 783_arcadia_pl there is heavy_traffic on the route to reach the garage is located at 657_ames_ave | 783_arcadia_pl is the address for chevron gas_station |
| perfect thank you | you re welcome reach reach fast enough | you re welcome happy to help |
| User | Response | Gold |
|---|---|---|
| show me directions to the nearest grocery_store | the nearest grocery_store is safeway | the nearest grocery_store is located 6_miles away at 452_arcadia_pl |
| pick the fastest route and with least traffic then send the address on my screen please | setting navigation to the route to on | safeway is located at 452_arcadia_pl and navigation is set |
| hope you picked the fastest route or no more gasoline for you car just kidding thank you | you re welcome gasoline gasoline at reach reach i fast enough | i did i did you re welcome |
| User | Response | Gold |
|---|---|---|
| when s my tennis match | your match on the the the the the the same | your tennis match is tuesday at 11am |
| okay great thank you | you re very welcome | you re very welcome |
