Bluez/Obexd upstream test result_20121102(bluez-4.101.767+ obexd-0.47.67)

Bluez/Obexd upstream test result_20121102(bluez-4.101.767+ obexd-0.47.67)

[Li, XiaX]

[-- Attachment #1: Type: text/plain, Size: 1184 bytes --]

Hi all,

QA finished upstream testing. The test is for bluez-4.101.767 and obexd-0.47.67. Against last, BlueZ is changed from 4.101.681 to 4.101.767, Obexd is changed from 0.47.66 to 0.47.67.
In this test, totally ran 100 case: 72 Pass, 10 Fail. Other 18 are blocked or unavailable (some cases validation method is still in investigating). The pass rate is 88% (pass / <pass + fail>). Ofono has not caught up with the BlueZ API changing in HFP profile.

New bugs:
===============================================
No

Re-open bugs:
===============================================
No

Verified bugs:
===============================================
No

Testing Environment
==============================================
Hardware:  netbook Eeepc 1005HA | Acer AspireOne NAV50
Image:     netbook-ia32-pinetrail-tizen_20120424.2
Linux Kernel: v3.4-rc7
bluez-4.101.767.g862e89c-1.1.i586
obexd-0.47.67.g01636c0-2.1.i586
obexd-server-0.47.67.g01636c0-2.1.i586
connman-1.8.48.gde9e458-1.1.i586
ofono-1.11.160.gd28d473-1.1.i586
Pulseaudio: 67602d8743e8e529919bb9fbb956aa77724a8e50 (oct, 6th)

For detailed test results, please see attached file.

Thanks
Li Xia


[-- Attachment #2: Bluetooth_upstream_quality_20121102.txt --]
[-- Type: text/plain, Size: 7550 bytes --]

== Detail Result ==
[PASS]: case passed <br>
[FAIL]: case failed <br>
[Block]: case is blocked by one bug <br>
[N/A]: case not available to be tested

=== Audio-A2DP ===
  [PASS] A2DP_001: audio sink connect/re-connect 
  [PASS] A2DP_002: stereo headset playback 
  [PASS] A2DP_003: stereo headset voice record 
  [PASS] A2DP_004: Codec support: SBC 
  [PASS] A2DP_005: Playback music on line
  [PASS] A2DP_006: SINK role, as speaker for other device music playing
    With some BT headset, we ever met issue [https://bugs.meego.com/show_bug.cgi?id=25480 Bug#25480 A2DP-source: pulseaudio fails to create bluez_sink and bluez_source]

=== Audio-AVRCP ===
  [PASS] AVRCP_001: Volume Up/Down
  [Block] AVRCP_002: Play/Pause (by unavailable media-player)
  [Block] AVRCP_003: Next/Privious (by unavailable media-player)
  [PASS] AVRCP_004: Connection Establish/Release
  [N/A] AVRCP_005: Audio metadata get.
    We still try to find avaliable media-player to support AVRCP-1.4

=== Audio-HFP ===
    Ofono needs to update its API, since BlueZ already took the changes. Here is bug [https://bugs.meego.com/show_bug.cgi?id=25748 Bug#25748 HFP: Ofono List-modems shows no modem after paired with phone]
  [FAIL] HFP_001: RFCOMM connection on AG
    Need install sbc for latest pulseaudio 
  [FAIL] HFP_002: list (ofono) hfp modem 
  [FAIL] HFP_003: HFP modem establishment (Ofono)
  [FAIL] HFP_004: Audio SNK and SRC establishment  
  [FAIL] HFP_005: voicecall, audio creates BT SNK/SRC 
  [FAIL] HFP_006: redirect AG SNK/SRC to local SRC/SNK
    BlueZ interface has some regression, bug is reported as [https://bugs.meego.com/show_bug.cgi?id=25473 Bug#25473 HFP: latest bluez cannot support pulseaudio to create bluez_sink and bluez_source]
    Pulseaudio has new crash bug: [https://bugs.meego.com/show_bug.cgi?id=25593 Bug#25593 Pulseaudio crashes after connect BT sink to alsa source]  
  [FAIL] HFP_007: Check AT-commands from HF part
  [FAIL] HFP_008: Connect BT Headset to HFP phone

=== Audio-HSP ===
  [PASS] HSP_001: Use mono headset to play music
  *** DUT is a Netbook, unable to take phone ***
  [N/A] HSP_002: Take incoming call by button-press
  [N/A] HSP_003: Audio transfer between AG and HS
  [PASS] HSP_004: Adjust Volume Up/Down

=== OBEX-FTP ===
  [PASS] FTP_001: pull/push files from/to server.
  [PASS] FTP_002: browse server files 
  [PASS] FTP_003: Client "delete file", "rename file"
  [PASS] FTP_004: Server enables FTP parameter  
  [PASS] FTP_005: Server sets sharing root path
  [PASS] FTP_006: Server handles all requirements
  [PASS] FTP_007: Server has ability to set permission for FTP
  [PASS] FTP_008: FTP data-rate about 30k/s~230k/s
  [PASS] FTP_009: Big size file transferred stable

=== OBEX-OPP ===
  [PASS] OPP_001: pull un-patterned object from server. 
  [PASS] OPP_002: Server enables OPP parameter
  [PASS] OPP_003: During object transferring, the progress is clear

=== OBEX-PBAP ===
  [PASS] PBAP_001: Client gets phone book entries from server
  [PASS] PBAP_002: Client gets ICH, OCH, MCH and CCH from server
  [FAIL] PBAP_003: PSE can provide PBAP daemon by enabling corresponding parameter
  Case failed due to [https://bugs.meego.com/show_bug.cgi?id=25598 Bug#25598, PBAP server fails to open /telecom/pb.vcf file]
  [PASS] PBAP_004: Both sides support vCard2.1/vCard3.0

=== OBEX-SYNC ===
  [PASS] SYNC_001: Server enables SYNC daemon
  [PASS] SYNC_002: During sync, Server can show "syncing..."
  [PASS] SYNC_003: client can set PIM fetching from INT
  [PASS] SYNC_004: Server get/put entire phonebook from/to client. 
  [PASS] SYNC_005: Client can support vCard2.1, vCard3.0

=== OBEX-MAP MCE ===
  [FAIL] MAP_001: MCE can browse message/folder list on MSE 
    Regression happened on client side, bug is reported as [https://bugs.meego.com/show_bug.cgi?id=25595 Bug#25595 MAP client fail to get message list from Samsung GT-i9100]
  [BLOCK] MAP_002: MCE can upload local message to MSE
  [BLOCK] MAP_003: MCE can delete the message on MSE side
  [BLOCK] MAP_004: MCE can take use of MSE to send message

=== Network-PAN ===
  [PASS] PAN_001: PANU can init nap0 device connect to NAP
  [PASS] PAN_002: PANU can get ip address or assigned static ip
  [PASS] PAN_003: PANU can logon internet website 
  [N/A] PAN_004: NAP can init bridge bnep 
  [N/A] PAN_005: NAP can support one or multiple PANU connection
  [N/A] PAN_006: NAP can have DHCP responding to each PANU
  Current connman does not support DHCP functions.

=== Network-BNEP ===
  [PASS] BNEP_001: Check BNEP support on DUT

=== Network-DUN ===
  [PASS] DUN_001: GW (DUT) can parse a series of AT commands from the data terminal. 
  [PASS] DUN_002: DT can build up rfcomm device by bluetooth and DUN modem by Ofono.
  [PASS] DUN_003: DT can use Ofono to dial up special service number ("*99#").
  [PASS] DUN_004: When network connected, DT can log on website in internet.

=== SIM-SAP ===
  The SAP test method is still in investigation. 
  [N/A] SAP_001: Server can enable a module to register Client
  [N/A] SAP_002: Server can power on/off SIM Card or reset it 
  [N/A] SAP_003: Server can disconnect Client  
  [N/A] SAP_004: Server can disconnect SIM
  [N/A] SAP_005: Client can connect to Server SIM
  [N/A] SAP_006: Client can power on Server SIM
  [N/A] SAP_007: Client can disconnect Server

=== Generic-GAP ===
  [PASS] GAP_001: PSCAN/ISCAN mode setting.
  [PASS] GAP_002: Active pairing to another bluetooth device.
  [PASS] GAP_003: Passive pairing, accepte pair master requirement
  [PASS] GAP_004: SSP supports 
  [PASS] GAP_005: If lost link-key, it needs re-pair 
  [PASS] GAP_006: reboot DUT with link-key restored, no need to re-pair 
  [PASS] GAP_007: Pair can be released

=== Generic-SDP ===
  [PASS] SDP_001: browse available service list in local
  [PASS] SDP_002: browse available service list from remote
  [PASS] SDP_003: browse service by RecHandle for detail info
  [PASS] SDP_004: Server can answer SDP searching request
  [PASS] SDP_005: Server can add/del/update service records

=== Others-HID ===
  [PASS] HID_001: Host can search nearby HID device.
  [PASS] HID_002: [BAT] Host can connect to HID device.
  [PASS] HID_003: Host can handle multiple human input/output devices.

=== HCI ===
  [PASS] HCI_001: Build hci connection between Dev_A and Dev_B.
  [PASS] HCI_002: Receive ACL data with HCI.
  [PASS] HCI_003: Send ACL data with HCI.
  [PASS] HCI_004: Change name of remote Dev by HCI.
  [PASS] HCI_005: Change class of remote Dev by HCI.
  [PASS] HCI_006: Read local HCI controller information.
  [PASS] HCI_007: Read remote HCI controller information.

=== L2CAP ===
  [PASS] L2CAP_001: Build l2cap connection between Dev_A and Dev_B.  
  [PASS] L2CAP_002: Dev_A and Dev_B take l2cap protocol to do pingpong.

=== RFCOMM ===
  [PASS] RFCOMM_001: Build rfcomm connection between Dev_A and Dev_B.  
  [PASS] RFCOMM_002: Dev_A and Dev_B take rfcomm protocol to do pingpong.

=== Settings ===
  [PASS] SET_001: [BAT] No error output during bluetoothd startup process.

=== Bluetooth Utils ===
Some basic checking for hciconfig, hcitool, sdptool commands. 
  [PASS] BTCMD_001: hciconfig -a
  [PASS] BTCMD_002: hciconfig <adapter> piscan
  [PASS] BTCMD_003: hciconfig <adapter> up/down  
  [PASS] BTCMD_004: hcitool scan
  [PASS] BTCMD_005: sdptool browse local
  [PASS] BTCMD_006: sdptool browse <ermote MAC>
  [PASS] BTCMD_007: sdptool add/del